-- Logs begin at Mon 2022-05-16 14:15:25 UTC, end at Mon 2022-05-16 15:40:40 UTC. -- May 16 15:11:57.187730 dv-cinder-790535-39-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 15:11:57.196693 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 15:11:57 2022] *** May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: nodename: dv-cinder-790535-39-iscsi May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: machine: x86_64 May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: clock source: unix May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: pcre jit disabled May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: detected number of CPU cores: 4 May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: current working directory: / May 16 15:11:57.198242 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: detected binary path: /usr/bin/uwsgi-core May 16 15:11:57.198959 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: your processes number limit is 47680 May 16 15:11:57.198959 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: your memory page size is 4096 bytes May 16 15:11:57.198959 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: detected max file descriptor number: 2048 May 16 15:11:57.198959 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: lock engine: pthread robust mutexes May 16 15:11:57.198959 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: thunder lock: enabled May 16 15:11:57.198959 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 15:11:57.198959 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 15:11:57.243227 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: Python main interpreter initialized at 0x5619275249c0 May 16 15:11:57.243227 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: python threads support enabled May 16 15:11:57.243227 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: your server socket listen backlog is limited to 100 connections May 16 15:11:57.243227 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: your mercy for graceful operations on workers is 90 seconds May 16 15:11:57.243542 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: mapped 403077 bytes (393 KB) for 2 cores May 16 15:11:57.243627 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: *** Operational MODE: preforking *** May 16 15:11:57.243872 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: *** uWSGI is running in multiple interpreter mode *** May 16 15:11:57.243872 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: spawned uWSGI master process (pid: 103233) May 16 15:11:57.244052 dv-cinder-790535-39-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 15:11:57.245397 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: spawned uWSGI worker 1 (pid: 103234, cores: 1) May 16 15:11:57.245397 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: spawned uWSGI worker 2 (pid: 103235, cores: 1) May 16 15:11:57.245397 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 15:11:58.451889 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:11:58.452638 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:11:59.184279 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:11:59.184279 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: from cryptography.utils import int_from_bytes May 16 15:11:59.184729 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:11:59.184729 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: from cryptography.utils import int_from_bytes May 16 15:11:59.186947 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:11:59.186947 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: from cryptography.utils import int_from_bytes May 16 15:11:59.187277 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:11:59.187277 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: from cryptography.utils import int_from_bytes May 16 15:12:01.813170 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:12:01.813732 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:12:01.813948 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:12:01.814359 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:12:01.814623 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:12:01.815014 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.815344 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.815672 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.815993 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.816329 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.816644 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.817137 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.817617 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.817952 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.818239 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.818564 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.818899 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-39-iscsi {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.819229 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.819545 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.819862 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.820185 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.820495 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.820823 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.821138 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.821641 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.822835 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.822835 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.822835 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.823178 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.823376 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.823689 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.824014 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.824330 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.824663 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.824978 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.825943 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-39-iscsi {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.826296 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.826619 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.826943 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.827364 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.827684 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.827995 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.828320 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.828646 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.828958 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.829288 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.829621 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.829934 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.830286 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.830598 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.830911 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.831226 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.831551 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.831862 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.832171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.832424 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.832736 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.833061 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.833383 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.833807 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.833964 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.834246 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.834576 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.834901 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.835216 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.835528 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.835841 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.836152 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.836464 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.836821 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.837089 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.837397 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.837729 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.838046 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.838400 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.838806 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.839360 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.839777 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.840036 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.840356 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.840725 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.841057 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.841370 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.841696 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.842025 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.842364 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.842677 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.842988 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.843313 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.843641 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.843952 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.844208 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.844523 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.844834 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.845158 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.845469 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.845779 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.846089 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.846423 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.846732 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.847048 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.847358 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.847669 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.847981 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.848288 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.848524 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:12:01.849046 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.849196 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:12:01.849349 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.849349 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.849660 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:12:01.849795 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.849938 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:12:01.850070 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.850209 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:12:01.850306 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.850386 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.850463 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.850634 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.850721 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.850961 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.851101 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.851286 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.851373 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.851621 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.851714 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.851934 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.852018 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.852257 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.852350 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.852567 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.852652 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.852881 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.852967 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.853144 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.853237 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.853464 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.853559 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.853792 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-39-iscsi {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.853877 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.854115 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.854240 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.854450 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.854535 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.854762 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.854848 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.855089 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.855176 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.855403 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.855488 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.855815 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.855913 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.856005 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.856083 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.856913 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.857243 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.857557 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.857868 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.858202 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.858511 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.858836 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.858950 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.859165 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.859288 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.859481 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.859793 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.860104 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.860429 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.860513 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.860770 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.860864 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.861173 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.861271 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.861650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.861821 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.862007 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.862203 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.862328 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.862473 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.862655 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.862753 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.862995 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.863081 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.863319 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.863412 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.863676 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.863761 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-39-iscsi {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.864010 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.864096 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.864328 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.864426 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.864645 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.864730 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.864966 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.865078 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.865288 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.865403 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.865611 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.865720 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.865944 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.866050 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.866287 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.866547 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.866634 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.866872 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.866973 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.867212 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.867407 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.867531 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.867617 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.867864 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.867948 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.868188 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.868293 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.868514 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.868611 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.868809 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.868894 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.869126 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.869219 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.869474 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.869564 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.869766 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.869858 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.870078 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.870195 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.870372 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.870461 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.870686 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.870770 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.871013 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.871106 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.871336 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.871435 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.871661 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.871754 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.871918 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.872005 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.872728 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.872859 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.873055 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.873181 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.873381 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.873502 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.873697 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.873819 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.874290 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.874468 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.874606 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.874719 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.874918 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.875066 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.875232 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.875390 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.875544 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.875711 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.875868 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.876032 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.876168 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.876358 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.876491 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.876675 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.876809 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.876994 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.877136 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.877312 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.877434 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.877623 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.877763 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.877933 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.878298 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.878442 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.878534 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.878612 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.878874 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.879199 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.879533 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.879848 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.880185 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.880498 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.880581 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.880816 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.880959 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.881133 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.881306 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.881449 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.881763 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.882078 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.882534 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.882853 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.882938 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.883183 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.883269 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.883646 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.883733 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.883993 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.884150 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.884321 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.884475 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.884661 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.884812 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.885002 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.885138 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.885321 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.885456 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.885584 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.885781 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.885898 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.886101 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.886246 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.886467 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.886579 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.886788 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.886895 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.887108 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.887196 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.887440 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.887584 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.887791 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.887882 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.888113 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.888198 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.888424 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.888560 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.888780 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.888876 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.889093 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.889179 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.889423 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.889509 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.889757 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.889841 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.890079 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.890211 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.890416 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.890604 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.890725 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.890809 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.891036 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.891121 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.891347 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.891430 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.891659 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.891746 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.891970 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.892054 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.892277 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.892434 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.892589 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.892690 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.892897 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.892989 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.893209 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.893353 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.893518 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.893602 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.893842 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.893933 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.894169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.894269 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.894485 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.894577 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.894797 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.894889 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.895108 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.895193 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.895420 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.895505 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.895746 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.895839 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.896054 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.896139 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.896367 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.896459 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.896690 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.896783 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.897004 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.897100 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.897316 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.897401 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.897626 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.897721 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.897936 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.898031 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.898275 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.898361 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.898587 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.898676 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.898896 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.898980 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.899207 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.899298 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.899514 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.899603 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.899837 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.900156 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.900486 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.900804 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.901131 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.901441 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.901669 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.901764 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.902048 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.902121 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.902421 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.902497 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.902777 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.903105 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.903447 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.903626 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.903767 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.903966 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.904086 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.904316 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:12:01.904677 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.904816 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.905035 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.905179 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.905355 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.905541 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.905678 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.905874 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.905994 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.906248 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.906356 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.906600 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.906690 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.906935 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.907023 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.907263 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.907350 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.907584 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.907697 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.907897 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.907996 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.908212 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.908299 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.908541 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.908651 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.908866 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.908973 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.909178 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.909326 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.909495 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.909661 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.909823 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.909999 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.910153 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.910352 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.910448 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.910676 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.910765 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.911003 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.911102 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.911321 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.911417 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.911652 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.911756 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.911967 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.912052 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.912338 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.912450 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.912597 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.912729 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.912908 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.912993 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.913225 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.913325 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.913540 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.913633 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.913847 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.913932 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.914185 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.914294 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.914504 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.914589 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.914834 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.914918 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.915150 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.915253 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.915477 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.915569 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.915801 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.915886 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.916111 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.916197 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.916419 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.916505 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.916746 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.916832 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.917059 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.917145 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.917367 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.917452 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.917677 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.917769 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.917987 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.918081 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.918354 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.918440 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.918668 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.918764 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.919511 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.919604 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.919830 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.919914 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.920154 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.920245 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.920470 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.920555 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.920786 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.920869 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.921101 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.921198 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.921509 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.921638 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.921744 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.921848 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.922039 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.922378 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.922696 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.923015 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.923333 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.923649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.923893 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.923978 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.924253 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.924328 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.924587 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.924907 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.925218 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.925470 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.925565 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.925836 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.925934 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.926223 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.926695 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.926849 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.927054 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.927210 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.927379 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.927466 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.927706 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.927795 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.928037 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.928183 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.928360 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.928496 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.928684 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.928818 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.929013 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.929149 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.929339 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.929482 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.929660 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.929837 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.929978 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.930071 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.930318 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.930405 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.930633 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.930720 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.930949 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.931035 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.931262 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.931420 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.931575 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.931744 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.931885 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.932165 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.932257 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.932400 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.932500 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.932725 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.932818 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.933049 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.933201 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.933444 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.933586 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.933718 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.933855 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.933987 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.934163 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.934385 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.934547 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.935173 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.935306 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.935490 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.935623 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.935833 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.935967 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.936099 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.936231 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.936399 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.936532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.936722 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.936854 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.937043 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.937178 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.937356 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.937458 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.937700 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.937808 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.938020 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.938140 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.938386 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.938495 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.938702 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.938796 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.939011 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.939096 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.939324 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.939419 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.939640 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.939794 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.939932 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.940065 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.940243 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.940386 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.940603 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.940732 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.940864 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.940996 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.941135 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.941281 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.941446 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.941581 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.941761 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.941895 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.942074 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.942201 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.942412 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.942502 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.942722 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.942810 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.943053 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.943138 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.943330 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.943651 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.943966 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.944277 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.944587 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.944902 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.945221 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.945305 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.945529 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.945604 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.945844 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.946170 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.946495 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.946799 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.946886 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.947108 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.947194 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.947415 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.947501 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.947893 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.947990 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.948362 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.948459 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.948678 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.948821 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.949013 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.949100 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.949333 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.949426 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.949647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.949771 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.949958 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.950044 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.950824 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.950915 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.951140 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.951227 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.951451 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.951549 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.951768 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.951855 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.952098 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.952184 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.952421 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.952515 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.952732 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.952819 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.953047 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.953357 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.953456 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.953668 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.953753 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.953978 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.954181 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.954318 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.954420 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.954628 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.954722 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.954939 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.955025 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.955249 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.955349 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.955555 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.955648 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.955860 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.955946 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.956200 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.956292 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.956498 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.956584 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.956806 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.956891 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.957115 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.957207 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.957424 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.957519 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.957764 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.957894 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.958070 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.958189 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.958439 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.958534 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.958753 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.958838 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.959073 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.959160 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.959387 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.959471 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.959700 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.959793 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.960017 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.960112 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.960330 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.960414 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.960639 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.960734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.960946 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.961031 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.961254 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.961339 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.961567 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.961730 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.961876 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.961963 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.962207 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.962297 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.962521 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.962618 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.962829 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.962923 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.963140 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.963270 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.963448 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.963534 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.963753 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.963846 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.964143 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.964234 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.964371 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.964457 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.964687 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.964771 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.964996 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.965079 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.965306 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.965391 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.965619 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.965731 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.966509 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.966657 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.966820 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.966970 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.967122 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.967208 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.967429 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.967503 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.967736 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.967811 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.968048 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.968151 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.968352 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.968464 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.968663 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.968751 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.968977 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.969272 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.969368 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.969599 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.969809 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.969901 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.970280 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.970383 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.970675 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.970842 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.971002 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.971165 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.971333 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.971473 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.971657 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.971783 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.971975 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.972244 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.972330 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.972563 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.972662 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.972880 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.972966 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.973204 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.973328 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.973518 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.973617 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.973833 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.973918 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.974164 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.974253 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.974489 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.974590 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.974802 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.974892 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.975116 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.975224 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.975431 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.975542 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.975739 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.975858 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.976053 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.976176 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.976374 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.976486 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.976794 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.976948 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.977108 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.977286 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.977436 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.977606 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.977744 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.977929 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.978053 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.978282 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.978387 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.978606 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.978698 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.978939 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.979024 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.979268 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.979354 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.979617 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.979712 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.979927 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.980013 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.980241 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.980343 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.980552 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.980708 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.980862 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.981021 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.981176 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.981353 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.981485 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.981683 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.981783 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.982007 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.982100 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.982361 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.982458 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.982670 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.982757 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.982985 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.983069 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.983296 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.983378 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.983607 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.983714 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.983920 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.984006 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.984226 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.984313 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.984540 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.984632 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.984847 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.984944 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.985171 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.985266 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.985479 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.985564 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.985787 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.985880 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.986092 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.986197 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.986423 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.986539 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.986767 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.986863 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.987075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.987160 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.987415 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.987508 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.987745 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.987839 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.988090 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.988174 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.988395 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.988486 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.988757 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.988862 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.989003 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.989087 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.989318 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.989402 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.989628 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.989715 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.989934 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.990020 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.990272 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.990382 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.990581 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.990667 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.990887 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.990972 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.991194 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.991284 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.991504 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.991589 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.991814 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.991907 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.992120 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.992213 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.992423 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.992506 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.992734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.992896 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.993047 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.993241 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.993343 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.993451 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.993656 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.993763 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.993967 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.994076 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.994301 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.994546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.994634 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.994912 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.995122 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.995225 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.995551 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.995676 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.995861 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.996186 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.996282 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.996521 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.996778 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.996866 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.997184 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.997336 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.997522 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.997850 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.997936 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.998186 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.998503 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.998601 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.998832 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.999314 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.999406 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.999690 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:01.999879 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.000003 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.000311 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.000457 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.000620 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.000928 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.001058 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.001239 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.001545 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.001633 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.001850 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.002180 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.002336 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.002491 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.002804 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.002933 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.003129 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.003441 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.003588 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.003749 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.004059 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.004200 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.004466 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.004682 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.004888 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.005096 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.005241 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.005375 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.005515 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.005649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.005790 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.005928 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.006061 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.006278 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.006369 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.006618 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.006718 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.006937 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.007023 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.007269 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.007355 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.007578 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.007677 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.007895 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.007981 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.008210 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.008303 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.008518 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.008612 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.008826 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.008926 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.009138 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.009256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.009444 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.009537 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.009757 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.009850 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.010065 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.010218 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.010416 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.010524 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.010724 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.010823 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.011034 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.011280 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.011385 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.011621 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.011734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.011944 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.012043 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.012266 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.012363 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.013097 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.013210 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.013409 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.013513 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.013723 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.013827 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.014037 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.014162 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.014377 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.014465 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.014686 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.014777 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.015003 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.015099 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.015317 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.015402 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.015630 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.015814 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.015938 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.016025 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.016242 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.016335 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.016564 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.016728 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.016876 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.016964 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.017188 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.017282 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.017510 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.017663 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.017832 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.017917 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.018188 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.018279 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.018499 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.018606 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.018812 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.018898 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.019131 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.019264 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.019433 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.019533 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.019744 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.019829 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.020051 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.020145 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.020362 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.020457 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.020674 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.020763 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.020982 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.021067 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.021294 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.021381 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.021601 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.021686 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.021904 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.021990 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.022236 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.022336 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.022548 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.022652 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.022946 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.023194 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.023308 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.023503 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.023603 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.023807 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.023917 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.024118 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.024346 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.024439 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.024671 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.024756 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.025008 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.025101 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.025336 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.025450 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.025660 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.025764 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.025973 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.026059 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.026323 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.026410 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.026657 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.026755 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.026968 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.027054 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.027277 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.027370 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.027592 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.027691 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.027902 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.027986 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.028227 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.028367 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.029084 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.029188 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.029378 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.029514 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.029690 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.029844 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.030012 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.030117 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.030349 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.030437 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.030674 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.030891 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.031140 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.031228 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.031548 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.031671 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.031878 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.032206 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.032300 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.032590 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.032682 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.032991 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.033146 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.033314 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.033488 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.033648 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.033819 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.034073 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.034179 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.034423 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.034522 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.034734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.034819 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.035049 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.035156 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.035359 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.035473 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.035673 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.035786 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.035988 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.036112 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.036298 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.036436 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.036611 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.036763 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.036920 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.037070 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.037251 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.037395 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.037560 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.037694 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.037868 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.038026 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.038197 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.038378 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.038515 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.038728 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.038818 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.039008 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.039119 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.039317 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.039444 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.039642 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.039729 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.039965 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.040153 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.040281 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.040368 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.040603 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.040727 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.040914 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.041089 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.041209 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.041333 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.041517 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.041645 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.041828 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.041972 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.042200 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.042318 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.042527 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.042631 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.042837 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.042926 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.043145 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.043231 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.043466 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.043595 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.043783 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.043885 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.044136 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.044249 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.044448 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.044557 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.044762 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.044859 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.045072 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.045168 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.045380 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.045486 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.045686 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.045949 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.046047 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.046315 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.046427 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.046619 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.046716 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.046941 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.047038 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.047253 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.047358 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.047575 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.047673 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.047884 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.047989 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.048195 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.048369 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.048518 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.048616 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.048829 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.048927 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.049135 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.049246 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.049441 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.049569 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.049747 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.049837 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.050059 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.050165 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.050400 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.050495 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.050717 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.050812 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.051030 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.051123 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.051343 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.051436 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.051659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.051744 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.051969 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.052056 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.052282 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.052369 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.052601 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.052701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.052919 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.053003 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.053245 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.053338 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.053570 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.053701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.053888 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.054200 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.054348 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.054532 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.054746 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.054900 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.055215 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.055355 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.055538 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.055781 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.055911 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.056111 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.056312 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.056447 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.056583 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.056756 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.056903 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.057055 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.057188 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.057384 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.057518 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.057695 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.057833 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.058024 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.058179 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.058372 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.058502 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.058683 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.058827 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.058993 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.059133 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.059301 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.059453 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.059681 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.059813 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.059990 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.060121 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.060308 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.060438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.060634 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.060776 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061027 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061192 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061281 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061359 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061597 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061683 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061903 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.061987 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.062247 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.062342 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.062552 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.062641 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.062867 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.062954 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.063185 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.063284 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.063496 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.063605 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.063804 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.063894 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.064112 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.064211 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.064423 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.064507 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.064729 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.064823 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.065044 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.065141 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.065352 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.065447 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.065660 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.065903 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.065990 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.066260 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.066350 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.066580 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.066676 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.066888 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.066988 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.067197 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.067291 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.067505 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.067593 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.067813 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.067910 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.068125 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.068211 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.068433 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.068520 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.068740 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.068835 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.069046 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.069133 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.069352 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.069438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.069659 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.069747 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.069991 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.070077 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.070350 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.070437 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.070667 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.070757 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.070983 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.071180 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.071320 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.071414 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.071605 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.071694 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.071914 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.072002 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.072239 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.072337 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.072563 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.072647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.072879 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.072966 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.073191 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.073288 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.073503 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.073586 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.073817 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.073912 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.074167 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.074269 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.074464 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.074550 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.074780 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.074869 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.075613 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.075709 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.075929 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.076017 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.076262 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.076481 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.076576 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.076889 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.077032 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.077218 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.077554 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.077687 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.077951 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.078260 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.078350 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.078597 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.078683 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.078920 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.079020 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.079256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.079343 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.079574 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.079797 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.079930 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.080119 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.080206 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.080458 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.080544 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.080790 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.080885 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.081107 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.081192 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.081427 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.081511 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.081748 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.081843 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.082076 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.082201 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.082413 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.082487 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.090413 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.090517 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.090585 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.090658 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.090761 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091353 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091451 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091520 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091651 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091729 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091817 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091896 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.091983 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092069 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092154 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092233 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092310 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092387 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092387 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.092546 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093075 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.093611 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.094111 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.094111 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.094111 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.094358 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.094602 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.094907 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.095216 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.095520 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.095832 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.096140 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.096448 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.096797 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.097120 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.097424 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.097726 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.098044 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.098384 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.098712 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.099026 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.099342 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.099689 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.100005 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.100553 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.100895 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.101221 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.101561 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.101897 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.102238 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.102628 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.103147 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.103708 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.104295 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.104806 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.104942 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.105268 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.105589 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.105911 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.106255 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.106608 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.106920 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.107235 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.107547 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.107964 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.108277 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.108645 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.108966 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.109284 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.109601 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.109757 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.109931 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.110271 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.110581 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.110894 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.111276 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.111637 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.111968 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.112287 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.112594 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.113033 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.113340 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.113671 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.114078 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.114659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.115240 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.115821 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.116410 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.117008 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.117606 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.118265 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.118916 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.119547 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.120159 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.120745 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.121332 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.121915 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.122584 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.123194 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.123778 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.124618 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.125207 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.125804 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.126404 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.127003 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.127586 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.128168 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.128764 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.129350 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.129933 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.130545 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.131138 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.131711 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.132072 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.132402 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.132908 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.133492 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.134080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.134698 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.135282 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.135923 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.136549 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.137163 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.137517 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.138404 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.138747 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.139078 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.139412 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.139744 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.140077 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.140396 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.140774 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.141052 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.141371 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.141687 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.142002 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.142347 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.142662 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.142995 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.143329 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.143640 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.143968 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.144290 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.144618 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.144935 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.145249 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.145585 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.145899 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.146233 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.146554 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.146869 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.147184 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.147502 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.147818 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.148146 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.148472 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.148783 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.149116 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.149442 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.149789 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.150102 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.150471 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.150812 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.151143 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.151674 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.152201 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:12:02.152645 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103235) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:12:02.176969 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.context [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),766bbfc3-40e3-4ccb-a93d-d8426b092689(cell1) {{(pid=103234) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:12:02.177806 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_db.sqlalchemy.engines [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.181385 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:12:02.183016 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:12:02.183831 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:12:02.186510 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:12:02.198811 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.200216 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.243622 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.context [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),766bbfc3-40e3-4ccb-a93d-d8426b092689(cell1) {{(pid=103235) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:12:02.248076 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_concurrency.lockutils [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:12:02.250937 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_concurrency.lockutils [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:12:02.251755 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_concurrency.lockutils [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:12:02.253714 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_concurrency.lockutils [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103235) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:12:02.266994 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_db.sqlalchemy.engines [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.271778 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_db.sqlalchemy.engines [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.364728 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.438000 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG oslo_db.sqlalchemy.engines [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103235) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:12:02.812042 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:12:02.819357 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:12:02.851705 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: WARNING keystonemiddleware.auth_token [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:12:02.859062 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: WARNING keystonemiddleware.auth_token [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:12:03.164611 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:12:03.171314 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:12:03.177392 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619275249c0 pid: 103234 (default app) May 16 15:12:03.179459 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:12:03.180635 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 May 16 15:12:03.181046 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Mon May 16 15:12:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:12:03.209532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: WARNING keystonemiddleware.auth_token [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:12:03.216198 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: WARNING keystonemiddleware.auth_token [None req-4004f20b-66ac-487b-84c3-1e34b9c358dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:12:03.222368 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619275249c0 pid: 103235 (default app) May 16 15:13:24.050111 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:24.051665 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 May 16 15:13:24.054374 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:24.476827 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-6b47a5f6-60e6-4d29-8001-90d5500dd6ac admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:24.504636 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-6b47a5f6-60e6-4d29-8001-90d5500dd6ac admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.445132 May 16 15:13:24.505437 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1291 bytes} [Mon May 16 15:13:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:26.785549 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:26.786511 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-b3345a0a-105c-4498-9f0c-3d18f7198b20 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 16 15:13:26.786917 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 3/4] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:26.845490 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-90207591-b672-41f8-8e4b-640077e1f33f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:26.868298 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:26.868298 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: warnings.warn(msg) May 16 15:13:26.967290 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-90207591-b672-41f8-8e4b-640077e1f33f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173853 May 16 15:13:26.967848 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 2/5] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:27.185693 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-7c93679d-8494-41a3-9f9b-7c598f0d6d88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:27.188257 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:27.188257 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: warnings.warn(msg) May 16 15:13:27.346969 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-7c93679d-8494-41a3-9f9b-7c598f0d6d88 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.371023 May 16 15:13:27.347612 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 4/6] 10.222.0.76 () {64 vars in 1335 bytes} [Mon May 16 15:13:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:29.643042 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-90207591-b672-41f8-8e4b-640077e1f33f admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:29.643998 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-90207591-b672-41f8-8e4b-640077e1f33f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001662 May 16 15:13:29.644404 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 3/7] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:29.747588 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-ef45af57-13be-43db-ba3d-dbe384d50acb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "ram": 512}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:29.765469 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:29.765469 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: warnings.warn(msg) May 16 15:13:29.836567 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-ef45af57-13be-43db-ba3d-dbe384d50acb admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.186094 May 16 15:13:29.837150 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 5/8] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:13:29.856429 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-27c060cb-2d2a-4c65-9803-10acd11bfa31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:29.858011 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:13:29.858011 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: warnings.warn(msg) May 16 15:13:29.926425 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-27c060cb-2d2a-4c65-9803-10acd11bfa31 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081131 May 16 15:13:29.927039 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 4/9] 10.222.0.76 () {64 vars in 1335 bytes} [Mon May 16 15:13:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:32.218113 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-ef45af57-13be-43db-ba3d-dbe384d50acb admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:32.219162 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-ef45af57-13be-43db-ba3d-dbe384d50acb admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 16 15:13:32.221515 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:32.278634 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-0cf2cdeb-fc81-45cc-a1bf-9bb7cec37c9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:32.363541 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-0cf2cdeb-fc81-45cc-a1bf-9bb7cec37c9d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138013 May 16 15:13:32.364415 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 5/11] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:13:32.377694 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-5d0cc820-9936-4a27-a345-2c04301fd800 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:32.458207 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-5d0cc820-9936-4a27-a345-2c04301fd800 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084893 May 16 15:13:32.458898 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 7/12] 10.222.0.76 () {64 vars in 1335 bytes} [Mon May 16 15:13:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:34.738939 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-0cf2cdeb-fc81-45cc-a1bf-9bb7cec37c9d admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:34.739880 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-0cf2cdeb-fc81-45cc-a1bf-9bb7cec37c9d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 May 16 15:13:34.740288 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 6/13] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:34.799701 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-6f15f2af-d80b-4525-89ab-32845ee10a96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:34.882053 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-6f15f2af-d80b-4525-89ab-32845ee10a96 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135662 May 16 15:13:34.882813 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 8/14] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:34.895235 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-1d0924c9-a4f2-4bae-a14f-5fe6aa078bdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:34.994794 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-1d0924c9-a4f2-4bae-a14f-5fe6aa078bdb admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103148 May 16 15:13:34.995334 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 7/15] 10.222.0.76 () {64 vars in 1335 bytes} [Mon May 16 15:13:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:37.451428 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-6f15f2af-d80b-4525-89ab-32845ee10a96 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:37.452442 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-6f15f2af-d80b-4525-89ab-32845ee10a96 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 16 15:13:37.452863 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 9/16] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:37.519814 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-9684426d-ea66-44c9-8d12-88e4c08ec96d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "ram": 4096, "swap": 0, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:37.597681 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-9684426d-ea66-44c9-8d12-88e4c08ec96d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138194 May 16 15:13:37.598383 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 8/17] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:37.609914 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-eb6bbbd2-7790-404c-8c0f-c0045a4c4d3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:37.663216 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-eb6bbbd2-7790-404c-8c0f-c0045a4c4d3f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056706 May 16 15:13:37.663818 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 10/18] 10.222.0.76 () {64 vars in 1335 bytes} [Mon May 16 15:13:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:39.989618 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-9684426d-ea66-44c9-8d12-88e4c08ec96d admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:39.990719 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-9684426d-ea66-44c9-8d12-88e4c08ec96d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 16 15:13:39.991260 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 9/19] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:40.051597 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-1d98c662-036e-40fc-aa1b-fba4f59115a5 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:40.077363 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-1d98c662-036e-40fc-aa1b-fba4f59115a5 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079863 May 16 15:13:40.077991 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 11/20] 10.222.0.76 () {60 vars in 1291 bytes} [Mon May 16 15:13:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:13:42.876416 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-9684426d-ea66-44c9-8d12-88e4c08ec96d admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:42.877485 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-9684426d-ea66-44c9-8d12-88e4c08ec96d admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 May 16 15:13:42.877895 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 10/21] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:13:42.954541 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-a4fd733a-1ba0-4d73-b429-0bc9af0dce88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:43.040747 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-a4fd733a-1ba0-4d73-b429-0bc9af0dce88 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.156900 May 16 15:13:43.042420 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 12/22] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:13:43.053821 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-d1a95419-ffa7-42d0-81fa-72c70897630b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:43.127203 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-d1a95419-ffa7-42d0-81fa-72c70897630b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077153 May 16 15:13:43.128062 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 11/23] 10.222.0.76 () {64 vars in 1332 bytes} [Mon May 16 15:13:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:45.732487 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-a4fd733a-1ba0-4d73-b429-0bc9af0dce88 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:45.733636 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-a4fd733a-1ba0-4d73-b429-0bc9af0dce88 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 May 16 15:13:45.734082 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:45.804380 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-575b05c3-c7e0-4628-b644-400aab8942a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:45.910774 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-575b05c3-c7e0-4628-b644-400aab8942a7 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.170446 May 16 15:13:45.911398 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 12/25] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:13:45.923760 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-5d4b00c9-ba4f-417a-bdb2-335df40c729b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:46.023432 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-5d4b00c9-ba4f-417a-bdb2-335df40c729b admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103293 May 16 15:13:46.024054 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 14/26] 10.222.0.76 () {64 vars in 1332 bytes} [Mon May 16 15:13:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:48.300741 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-575b05c3-c7e0-4628-b644-400aab8942a7 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:48.301832 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-575b05c3-c7e0-4628-b644-400aab8942a7 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 16 15:13:48.302268 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 13/27] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:48.358715 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b57d4ac1-5d13-4175-bdcd-8bd3aae24552 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "ram": 4096}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:48.436584 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-b57d4ac1-5d13-4175-bdcd-8bd3aae24552 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128533 May 16 15:13:48.437174 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 15/28] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:48.449630 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-76b26b57-0ae2-45b9-ab9c-351e45e7b13f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:48.514414 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-76b26b57-0ae2-45b9-ab9c-351e45e7b13f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068973 May 16 15:13:48.515003 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 14/29] 10.222.0.76 () {64 vars in 1332 bytes} [Mon May 16 15:13:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:13:50.793820 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b57d4ac1-5d13-4175-bdcd-8bd3aae24552 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:50.794868 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-b57d4ac1-5d13-4175-bdcd-8bd3aae24552 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 16 15:13:50.795269 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 16/30] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:50.858201 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-9315d6a4-d536-49dd-8b8e-546e6ceeb562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:50.934620 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-9315d6a4-d536-49dd-8b8e-546e6ceeb562 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133245 May 16 15:13:50.935198 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 15/31] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:50.950413 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-662bb442-14a0-40ed-b44a-dc526eb3d475 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:51.017802 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-662bb442-14a0-40ed-b44a-dc526eb3d475 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071818 May 16 15:13:51.018688 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 17/32] 10.222.0.76 () {64 vars in 1332 bytes} [Mon May 16 15:13:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:13:53.429676 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-9315d6a4-d536-49dd-8b8e-546e6ceeb562 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:13:53.430754 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-9315d6a4-d536-49dd-8b8e-546e6ceeb562 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 16 15:13:53.431153 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 16/33] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:13:53.491553 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f58c4d96-be24-4559-901b-62c3c8b197d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:53.598344 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-f58c4d96-be24-4559-901b-62c3c8b197d1 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.161296 May 16 15:13:53.598986 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 18/34] 10.222.0.76 () {64 vars in 1282 bytes} [Mon May 16 15:13:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:13:53.611615 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-dac38b99-2bef-4193-b89b-a0ea76730843 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:13:53.703908 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-dac38b99-2bef-4193-b89b-a0ea76730843 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095605 May 16 15:13:53.704987 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 17/35] 10.222.0.76 () {64 vars in 1332 bytes} [Mon May 16 15:13:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:14:17.502048 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f58c4d96-be24-4559-901b-62c3c8b197d1 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:17.503094 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-f58c4d96-be24-4559-901b-62c3c8b197d1 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 16 15:14:17.503493 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 19/36] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:17.564616 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-d198cb7a-4a27-471c-a192-d429f9101ede admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:17.583472 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-d198cb7a-4a27-471c-a192-d429f9101ede admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073531 May 16 15:14:17.584015 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 18/37] 10.222.0.76 () {60 vars in 1291 bytes} [Mon May 16 15:14:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:14:18.582413 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f58c4d96-be24-4559-901b-62c3c8b197d1 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:18.583429 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-f58c4d96-be24-4559-901b-62c3c8b197d1 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 16 15:14:18.583838 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 20/38] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:18.780686 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-ed50fe77-3908-499d-b0e3-7372495de7f5 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:18.786308 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.wsgi [None req-ed50fe77-3908-499d-b0e3-7372495de7f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-ed50fe77-3908-499d-b0e3-7372495de7f5 admin admin] Request method failure captured: May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Accept: application/json May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Accept-Encoding: gzip, deflate May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Connection: keep-alive May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Content-Length: 0 May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Host: 10.222.0.76 May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Openstack-Api-Version: compute 2.90 May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Openstack-System-Scope: None May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: User-Agent: python-novaclient May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Auth-Token: gAAAAABigmpKxqrmpfxlsJAM0hfqi_hUEYXBFbFBlf6hhexYwLR4aQfFcqoYNP5kFq4JAzZ2dT7R7IGjE4AnTBTrTWBIXEqywp8kjMCNOQuDfLbIPrXCJdKvHPqggFWOp3HzpHWj6Sa5f7OVp3nfYEcAGW7TiLX1tgU6-tl2Bp27uQ5JfGlR__w May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Domain-Id: None May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Domain-Name: None May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Identity-Status: Confirmed May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Is-Admin-Project: True May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Domain-Id: default May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Domain-Name: Default May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Name: admin May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Role: admin,reader,member May 16 15:14:18.789532 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Roles: admin,reader,member May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1c01b64ed2e84249921cacc6ee5ef7ac", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant: admin May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant-Name: admin May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User: admin May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Domain-Id: default May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Domain-Name: Default May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Id: cfa3cc953e414bc0b20f729623352259 May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Name: admin May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: method: > May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: exception: Flavor 42 could not be found. May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: action_args: {'id': '42'} May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:14:18.791650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:18.792530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:18.793659 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-ed50fe77-3908-499d-b0e3-7372495de7f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:14:18.794795 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-ed50fe77-3908-499d-b0e3-7372495de7f5 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066621 May 16 15:14:18.794795 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1190 bytes} [Mon May 16 15:14:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:14:18.801172 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f11f922c-e1fa-48a4-bd6a-b82cb9cc85e1 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:18.823047 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-f11f922c-e1fa-48a4-bd6a-b82cb9cc85e1 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025360 May 16 15:14:18.823585 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 21/40] 10.222.0.76 () {60 vars in 1210 bytes} [Mon May 16 15:14:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:14:18.840530 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-8ba78f58-3da3-4e3b-bf8c-b9fdd910a136 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:18.861470 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-8ba78f58-3da3-4e3b-bf8c-b9fdd910a136 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024935 May 16 15:14:18.862012 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 20/41] 10.222.0.76 () {60 vars in 1210 bytes} [Mon May 16 15:14:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:14:18.872432 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b13fead9-3ba6-48c8-b119-e7637d3283dc admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:18.878106 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.wsgi [None req-b13fead9-3ba6-48c8-b119-e7637d3283dc admin admin] HTTP exception thrown: Flavor 42 could not be found. May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b13fead9-3ba6-48c8-b119-e7637d3283dc admin admin] Request method failure captured: May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Accept: application/json May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Accept-Encoding: gzip, deflate May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Connection: keep-alive May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Content-Length: 0 May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Host: 10.222.0.76 May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Openstack-Api-Version: compute 2.90 May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Openstack-System-Scope: None May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: User-Agent: python-novaclient May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Auth-Token: gAAAAABigmpKxqrmpfxlsJAM0hfqi_hUEYXBFbFBlf6hhexYwLR4aQfFcqoYNP5kFq4JAzZ2dT7R7IGjE4AnTBTrTWBIXEqywp8kjMCNOQuDfLbIPrXCJdKvHPqggFWOp3HzpHWj6Sa5f7OVp3nfYEcAGW7TiLX1tgU6-tl2Bp27uQ5JfGlR__w May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Domain-Id: None May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Domain-Name: None May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Identity-Status: Confirmed May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Is-Admin-Project: True May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Domain-Id: default May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Domain-Name: Default May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Name: admin May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Role: admin,reader,member May 16 15:14:18.881337 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Roles: admin,reader,member May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1c01b64ed2e84249921cacc6ee5ef7ac", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant: admin May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant-Name: admin May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User: admin May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Domain-Id: default May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Domain-Name: Default May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Id: cfa3cc953e414bc0b20f729623352259 May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Name: admin May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: method: > May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: exception: Flavor 42 could not be found. May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: action_args: {'id': '42'} May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:14:18.882959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:18.883945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:18.885256 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-b13fead9-3ba6-48c8-b119-e7637d3283dc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:14:18.886480 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-b13fead9-3ba6-48c8-b119-e7637d3283dc admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015122 May 16 15:14:18.886480 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 22/42] 10.222.0.76 () {60 vars in 1190 bytes} [Mon May 16 15:14:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:14:19.756863 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-8ba78f58-3da3-4e3b-bf8c-b9fdd910a136 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:19.757866 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-8ba78f58-3da3-4e3b-bf8c-b9fdd910a136 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 May 16 15:14:19.758290 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 21/43] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:19.943924 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-becee41f-b91f-4390-a09d-61bde8d6e7a9 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:19.949147 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.wsgi [None req-becee41f-b91f-4390-a09d-61bde8d6e7a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-becee41f-b91f-4390-a09d-61bde8d6e7a9 admin admin] Request method failure captured: May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Accept: application/json May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Accept-Encoding: gzip, deflate May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Connection: keep-alive May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Content-Length: 0 May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Host: 10.222.0.76 May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Openstack-Api-Version: compute 2.90 May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Openstack-System-Scope: None May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: User-Agent: python-novaclient May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Auth-Token: gAAAAABigmpLt_GgBZjrHiRk3Yh2S8JP_OCiw9ucId5Z_IfpRMeIsZfdb3h6PA-AHde6qBle-KYf_31dyJXgTSiohPqfJJ_6VcOXUF5xfByCX_qOxnpZMhgEfbSwsj5V1jwXQ2aIxouZRI2nFvavdoFERFKLzkJ86nptEvdblgSFErAvYcOKrR0 May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Domain-Id: None May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Domain-Name: None May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Identity-Status: Confirmed May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Is-Admin-Project: True May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Domain-Id: default May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Domain-Name: Default May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Name: admin May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Role: admin,reader,member May 16 15:14:19.950653 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Roles: admin,reader,member May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1c01b64ed2e84249921cacc6ee5ef7ac", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant: admin May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant-Name: admin May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User: admin May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Domain-Id: default May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Domain-Name: Default May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Id: cfa3cc953e414bc0b20f729623352259 May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Name: admin May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: method: > May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: exception: Flavor 84 could not be found. May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: action_args: {'id': '84'} May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:14:19.957609 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:19.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:19.959909 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-becee41f-b91f-4390-a09d-61bde8d6e7a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:14:19.961209 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-becee41f-b91f-4390-a09d-61bde8d6e7a9 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060120 May 16 15:14:19.961209 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 23/44] 10.222.0.76 () {60 vars in 1190 bytes} [Mon May 16 15:14:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:14:19.961780 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-59c28099-7c2e-4bfb-89f2-58ef0fd8a736 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:19.975735 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-59c28099-7c2e-4bfb-89f2-58ef0fd8a736 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017515 May 16 15:14:19.976264 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 22/45] 10.222.0.76 () {60 vars in 1210 bytes} [Mon May 16 15:14:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:14:19.985974 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-80ad8925-8e2a-480e-828b-e191638b3bfa admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:19.999447 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-80ad8925-8e2a-480e-828b-e191638b3bfa admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016985 May 16 15:14:20.000229 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 24/46] 10.222.0.76 () {60 vars in 1210 bytes} [Mon May 16 15:14:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:14:20.008878 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-10060479-fe41-4c45-b388-f75d5fb5f40c admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:20.013937 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.wsgi [None req-10060479-fe41-4c45-b388-f75d5fb5f40c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-10060479-fe41-4c45-b388-f75d5fb5f40c admin admin] Request method failure captured: May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Accept: application/json May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Accept-Encoding: gzip, deflate May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Connection: keep-alive May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Content-Length: 0 May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Host: 10.222.0.76 May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Openstack-Api-Version: compute 2.90 May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Openstack-System-Scope: None May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: User-Agent: python-novaclient May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Auth-Token: gAAAAABigmpLt_GgBZjrHiRk3Yh2S8JP_OCiw9ucId5Z_IfpRMeIsZfdb3h6PA-AHde6qBle-KYf_31dyJXgTSiohPqfJJ_6VcOXUF5xfByCX_qOxnpZMhgEfbSwsj5V1jwXQ2aIxouZRI2nFvavdoFERFKLzkJ86nptEvdblgSFErAvYcOKrR0 May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Domain-Id: None May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Domain-Name: None May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Identity-Status: Confirmed May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Is-Admin-Project: True May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Domain-Id: default May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Domain-Name: Default May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Name: admin May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Role: admin,reader,member May 16 15:14:20.015484 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Roles: admin,reader,member May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1c01b64ed2e84249921cacc6ee5ef7ac", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant: admin May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant-Name: admin May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User: admin May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Domain-Id: default May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Domain-Name: Default May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Id: cfa3cc953e414bc0b20f729623352259 May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Name: admin May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: method: > May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: exception: Flavor 84 could not be found. May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: action_args: {'id': '84'} May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:14:20.017080 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:20.018169 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:20.019438 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-10060479-fe41-4c45-b388-f75d5fb5f40c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:14:20.020673 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-10060479-fe41-4c45-b388-f75d5fb5f40c admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011419 May 16 15:14:20.020673 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 23/47] 10.222.0.76 () {60 vars in 1190 bytes} [Mon May 16 15:14:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:14:20.900432 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-80ad8925-8e2a-480e-828b-e191638b3bfa admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:20.901445 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-80ad8925-8e2a-480e-828b-e191638b3bfa admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 May 16 15:14:20.901844 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 25/48] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:21.089609 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-72c2f09f-e81c-4cb4-a6bd-984a9101be94 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:21.095209 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.wsgi [None req-72c2f09f-e81c-4cb4-a6bd-984a9101be94 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-72c2f09f-e81c-4cb4-a6bd-984a9101be94 admin admin] Request method failure captured: May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Accept: application/json May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Accept-Encoding: gzip, deflate May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Connection: keep-alive May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Content-Length: 0 May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Host: 10.222.0.76 May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Openstack-Api-Version: compute 2.90 May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Openstack-System-Scope: None May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: User-Agent: python-novaclient May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Auth-Token: gAAAAABigmpMEqjtGeKtOEbAfGW7f_h0KqS2VZesnOC7x1ZNEFslnP_gvdw5ADAEWNzl4xh7L9Kwz1RAWdRckc6dy2yW3jqSPuI-wUKjk_qJmcVx_tAlf280uQackUn6jqlaXMcVKi8wf6TxLl3ozO2fJMCEiwK17uNsvj_eVXLvK4btC8MoWfg May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Domain-Id: None May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Domain-Name: None May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Identity-Status: Confirmed May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Is-Admin-Project: True May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Domain-Id: default May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Domain-Name: Default May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Project-Name: admin May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Role: admin,reader,member May 16 15:14:21.096701 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Roles: admin,reader,member May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1c01b64ed2e84249921cacc6ee5ef7ac", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant: admin May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-Tenant-Name: admin May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User: admin May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Domain-Id: default May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Domain-Name: Default May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Id: cfa3cc953e414bc0b20f729623352259 May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: X-User-Name: admin May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: method: > May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: exception: Flavor 451 could not be found. May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: action_args: {'id': '451'} May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:14:21.098273 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:21.099285 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: ERROR nova.api.openstack.wsgi May 16 15:14:21.100734 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-72c2f09f-e81c-4cb4-a6bd-984a9101be94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103235) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:14:21.101957 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-72c2f09f-e81c-4cb4-a6bd-984a9101be94 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059744 May 16 15:14:21.101957 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 24/49] 10.222.0.76 () {60 vars in 1193 bytes} [Mon May 16 15:14:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:14:21.107890 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-8632eead-f278-43c5-af80-277b7c32fd6b admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:21.121072 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-8632eead-f278-43c5-af80-277b7c32fd6b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016728 May 16 15:14:21.121529 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 26/50] 10.222.0.76 () {60 vars in 1210 bytes} [Mon May 16 15:14:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:14:21.130787 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:21.144520 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017164 May 16 15:14:21.145041 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 25/51] 10.222.0.76 () {60 vars in 1210 bytes} [Mon May 16 15:14:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:14:21.154506 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-fb070ee2-c32a-42bd-add4-417aa9f8ec05 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:21.159648 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.wsgi [None req-fb070ee2-c32a-42bd-add4-417aa9f8ec05 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-fb070ee2-c32a-42bd-add4-417aa9f8ec05 admin admin] Request method failure captured: May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Accept: application/json May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Accept-Encoding: gzip, deflate May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Connection: keep-alive May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Content-Length: 0 May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Host: 10.222.0.76 May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Openstack-Api-Version: compute 2.90 May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Openstack-System-Scope: None May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: User-Agent: python-novaclient May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Auth-Token: gAAAAABigmpMEqjtGeKtOEbAfGW7f_h0KqS2VZesnOC7x1ZNEFslnP_gvdw5ADAEWNzl4xh7L9Kwz1RAWdRckc6dy2yW3jqSPuI-wUKjk_qJmcVx_tAlf280uQackUn6jqlaXMcVKi8wf6TxLl3ozO2fJMCEiwK17uNsvj_eVXLvK4btC8MoWfg May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Domain-Id: None May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Domain-Name: None May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Identity-Status: Confirmed May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Is-Admin-Project: True May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Openstack-Nova-Api-Version: 2.90 May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Domain-Id: default May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Domain-Name: Default May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Project-Name: admin May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Role: admin,reader,member May 16 15:14:21.161171 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Roles: admin,reader,member May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_1c01b64ed2e84249921cacc6ee5ef7ac", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/1c01b64ed2e84249921cacc6ee5ef7ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant: admin May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant-Id: 1c01b64ed2e84249921cacc6ee5ef7ac May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-Tenant-Name: admin May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User: admin May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Domain-Id: default May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Domain-Name: Default May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Id: cfa3cc953e414bc0b20f729623352259 May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: X-User-Name: admin May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: method: > May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: exception: Flavor 451 could not be found. May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: action_args: {'id': '451'} May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:14:21.162723 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:21.163649 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi May 16 15:14:21.164945 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-fb070ee2-c32a-42bd-add4-417aa9f8ec05 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:14:21.166182 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-fb070ee2-c32a-42bd-add4-417aa9f8ec05 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011433 May 16 15:14:21.166182 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1193 bytes} [Mon May 16 15:14:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 16 15:14:22.051177 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:22.052192 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 16 15:14:22.052585 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:22.243690 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-4055a160-9be7-4292-be62-308c758a6ec6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:14:22.371725 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-4055a160-9be7-4292-be62-308c758a6ec6 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.182318 May 16 15:14:22.372257 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 28/54] 10.222.0.76 () {64 vars in 1235 bytes} [Mon May 16 15:14:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:14:23.288840 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:23.289851 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 16 15:14:23.290823 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:23.476875 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-a0c4c3b5-f5c0-4650-835a-590f68f1c9da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:14:23.567954 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-a0c4c3b5-f5c0-4650-835a-590f68f1c9da admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.142931 May 16 15:14:23.568621 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 29/56] 10.222.0.76 () {64 vars in 1235 bytes} [Mon May 16 15:14:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:14:24.460973 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:24.462585 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 16 15:14:24.462989 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 28/57] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:24.651776 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-4e8a6457-f3ab-49fd-b6b4-114883b77cb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:14:24.749409 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-4e8a6457-f3ab-49fd-b6b4-114883b77cb3 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.150306 May 16 15:14:24.750233 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 30/58] 10.222.0.76 () {64 vars in 1235 bytes} [Mon May 16 15:14:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:14:25.645400 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:25.646447 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 16 15:14:25.646849 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 29/59] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:25.836703 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-459b4d4b-7f3e-4261-b69a-0e9721c22063 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:14:25.961386 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-459b4d4b-7f3e-4261-b69a-0e9721c22063 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.176791 May 16 15:14:25.961937 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 31/60] 10.222.0.76 () {64 vars in 1235 bytes} [Mon May 16 15:14:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:14:26.837899 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:26.838924 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 May 16 15:14:26.839283 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 30/61] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:14:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:14:27.037977 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-38308d69-aeec-47d8-b5fb-7650bd57e743 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:14:27.057289 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-38308d69-aeec-47d8-b5fb-7650bd57e743 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069928 May 16 15:14:27.057825 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 32/62] 10.222.0.76 () {60 vars in 1202 bytes} [Mon May 16 15:14:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:32.698935 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:32.699966 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-5b1f7da2-f109-45b2-ba1c-b91f96f22f12 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 May 16 15:15:32.700363 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 31/63] 10.222.0.76 () {54 vars in 930 bytes} [Mon May 16 15:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:15:32.759422 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-77510204-75b7-4208-85b6-58c6f178fd38 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:32.777833 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-77510204-75b7-4208-85b6-58c6f178fd38 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071405 May 16 15:15:32.778398 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1291 bytes} [Mon May 16 15:15:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:15:32.800520 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-55243b56-0f42-4f21-bed3-26f206e38138 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:32.808592 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-55243b56-0f42-4f21-bed3-26f206e38138 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012306 May 16 15:15:32.809107 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 32/65] 10.222.0.76 () {60 vars in 1282 bytes} [Mon May 16 15:15:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:32.820524 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-86045fd9-4a76-480c-8ca1-d622bc60fbad admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:32.828295 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-86045fd9-4a76-480c-8ca1-d622bc60fbad admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011795 May 16 15:15:32.828821 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 34/66] 10.222.0.76 () {60 vars in 1285 bytes} [Mon May 16 15:15:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:32.839579 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:32.846976 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010952 May 16 15:15:32.847496 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 33/67] 10.222.0.76 () {60 vars in 1285 bytes} [Mon May 16 15:15:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:15:32.858415 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-be02c880-ced6-49ec-9b41-c423f7f09ee8 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:15:32.865890 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-be02c880-ced6-49ec-9b41-c423f7f09ee8 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011001 May 16 15:15:32.866447 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1282 bytes} [Mon May 16 15:15:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:19:06.798823 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:06.799835 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 16 15:19:06.800224 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 34/69] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:19:07.062962 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-0964f679-b0e8-4a4b-933c-c46942c9693e admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:07.065019 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:19:07.065019 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: warnings.warn(msg) May 16 15:19:07.066648 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-0964f679-b0e8-4a4b-933c-c46942c9693e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.067991 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-0964f679-b0e8-4a4b-933c-c46942c9693e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.068671 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-0964f679-b0e8-4a4b-933c-c46942c9693e admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:07.068792 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-0964f679-b0e8-4a4b-933c-c46942c9693e admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:07.114151 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-0964f679-b0e8-4a4b-933c-c46942c9693e admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.162390 May 16 15:19:07.114744 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 36/70] 10.222.0.76 () {60 vars in 1193 bytes} [Mon May 16 15:19:06 2022] GET /compute/v2.1/os-services => generated 794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:19:08.088517 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.089543 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 16 15:19:08.089940 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 35/71] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:08.283347 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-3240e06f-4383-4064-a672-f0ed0465397e admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:08.284511 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:19:08.284511 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: warnings.warn(msg) May 16 15:19:08.285693 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-3240e06f-4383-4064-a672-f0ed0465397e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.286180 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-3240e06f-4383-4064-a672-f0ed0465397e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.286984 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-3240e06f-4383-4064-a672-f0ed0465397e admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:08.287446 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-3240e06f-4383-4064-a672-f0ed0465397e admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:08.306962 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-3240e06f-4383-4064-a672-f0ed0465397e admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074723 May 16 15:19:08.307458 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 37/72] 10.222.0.76 () {60 vars in 1193 bytes} [Mon May 16 15:19:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:19:19.657264 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.658289 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 May 16 15:19:19.658686 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 36/73] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:19.846312 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-e1cf922c-e606-49c5-a5a3-27cb0f66b019 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:19.847470 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:19:19.847470 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: warnings.warn(msg) May 16 15:19:19.848640 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-e1cf922c-e606-49c5-a5a3-27cb0f66b019 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.849079 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-e1cf922c-e606-49c5-a5a3-27cb0f66b019 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.849862 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-e1cf922c-e606-49c5-a5a3-27cb0f66b019 admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:19.850324 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-e1cf922c-e606-49c5-a5a3-27cb0f66b019 admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:19.874535 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-e1cf922c-e606-49c5-a5a3-27cb0f66b019 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078609 May 16 15:19:19.875095 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 38/74] 10.222.0.76 () {60 vars in 1193 bytes} [Mon May 16 15:19:19 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:19:20.766650 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: DEBUG nova.api.openstack.wsgi [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] Calling method '>' {{(pid=103235) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:20.767718 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: INFO nova.api.openstack.requestlog [None req-67045e2d-380e-4345-94d9-c25213058c61 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 May 16 15:19:20.768120 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: [pid: 103235|app: 0|req: 37/75] 10.222.0.76 () {56 vars in 1074 bytes} [Mon May 16 15:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:19:20.956160 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-d9097f2a-8616-4ec2-97c5-97ad984db62f admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:19:20.957315 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:19:20.957315 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: warnings.warn(msg) May 16 15:19:20.958521 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-d9097f2a-8616-4ec2-97c5-97ad984db62f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.958959 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-d9097f2a-8616-4ec2-97c5-97ad984db62f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.959762 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-d9097f2a-8616-4ec2-97c5-97ad984db62f admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:19:20.960189 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-d9097f2a-8616-4ec2-97c5-97ad984db62f admin admin] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:19:20.982176 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-d9097f2a-8616-4ec2-97c5-97ad984db62f admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077143 May 16 15:19:20.982727 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 39/76] 10.222.0.76 () {60 vars in 1193 bytes} [Mon May 16 15:19:20 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:20:19.948409 dv-cinder-790535-39-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 16 15:20:19.948998 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: Mon May 16 15:20:19 2022 - graceful shutdown triggered... May 16 15:20:19.949466 dv-cinder-790535-39-iscsi devstack@n-api.service[103234]: Gracefully killing worker 1 (pid: 103234)... May 16 15:20:19.949866 dv-cinder-790535-39-iscsi devstack@n-api.service[103235]: Gracefully killing worker 2 (pid: 103235)... May 16 15:20:20.950105 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: worker 1 buried after 1 seconds May 16 15:20:20.950672 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: worker 2 buried after 1 seconds May 16 15:20:20.950672 dv-cinder-790535-39-iscsi devstack@n-api.service[103233]: goodbye to uWSGI. May 16 15:20:20.951706 dv-cinder-790535-39-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 16 15:20:20.952274 dv-cinder-790535-39-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 16 15:20:20.955564 dv-cinder-790535-39-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 16 15:20:20.969892 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 15:20:20 2022] *** May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: nodename: dv-cinder-790535-39-iscsi May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: machine: x86_64 May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: clock source: unix May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: pcre jit disabled May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: detected number of CPU cores: 4 May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: current working directory: / May 16 15:20:20.985840 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: detected binary path: /usr/bin/uwsgi-core May 16 15:20:20.986727 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: your processes number limit is 47680 May 16 15:20:20.986727 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: your memory page size is 4096 bytes May 16 15:20:20.986727 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: detected max file descriptor number: 2048 May 16 15:20:20.986727 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: lock engine: pthread robust mutexes May 16 15:20:20.986727 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: thunder lock: enabled May 16 15:20:20.986727 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 16 15:20:20.986727 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 15:20:21.037095 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: Python main interpreter initialized at 0x55b8bc5a69c0 May 16 15:20:21.037095 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: python threads support enabled May 16 15:20:21.037095 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: your server socket listen backlog is limited to 100 connections May 16 15:20:21.037095 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: your mercy for graceful operations on workers is 90 seconds May 16 15:20:21.037535 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: mapped 403077 bytes (393 KB) for 2 cores May 16 15:20:21.037535 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: *** Operational MODE: preforking *** May 16 15:20:21.037809 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: *** uWSGI is running in multiple interpreter mode *** May 16 15:20:21.037809 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: spawned uWSGI master process (pid: 117593) May 16 15:20:21.038034 dv-cinder-790535-39-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 16 15:20:21.038656 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: spawned uWSGI worker 1 (pid: 117615, cores: 1) May 16 15:20:21.040334 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: spawned uWSGI worker 2 (pid: 117616, cores: 1) May 16 15:20:21.040334 dv-cinder-790535-39-iscsi devstack@n-api.service[117593]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 15:20:22.263174 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:20:22.271381 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 16 15:20:23.080111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:20:23.080111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: from cryptography.utils import int_from_bytes May 16 15:20:23.080424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:20:23.080424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: from cryptography.utils import int_from_bytes May 16 15:20:23.094388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:20:23.094388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: from cryptography.utils import int_from_bytes May 16 15:20:23.094719 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 15:20:23.094719 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: from cryptography.utils import int_from_bytes May 16 15:20:25.527821 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:20:25.527821 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:20:25.528431 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:20:25.528714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:20:25.528892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:20:25.529233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.529563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.529888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.530238 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.530575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.531045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.531230 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.531517 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.532384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.532651 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.532968 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.533298 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-39-iscsi {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.533622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.533932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.534274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.534590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.534911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.535236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.535545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.536045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.536775 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.537328 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.537820 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.538357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.538850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.539169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.539652 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.539973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.540307 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.540617 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.541022 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-39-iscsi {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.541338 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.541663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.541978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.542415 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.548926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.549549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.549549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.549549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.549549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.549549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.549549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.549968 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.550445 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.550445 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.550727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.551042 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.551347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.551662 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.551981 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.552276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.552585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.552907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.553224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.553548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.553710 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 15:20:25.554175 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.554289 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 15:20:25.554366 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.554563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 15:20:25.554722 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.554876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.555022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 15:20:25.555167 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.555324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 15:20:25.555469 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.555621 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.555765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.555916 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.556069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.556264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.556425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.556620 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.556778 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.556935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.557089 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.557239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.557390 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.557534 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.557677 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.557835 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.557979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.558151 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.558330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.558495 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.558673 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.558835 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.558979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.559123 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.559266 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790535-39-iscsi {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.559410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.559563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.559720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.559873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.560017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.560171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.560368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.560536 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.560694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.560844 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.561015 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.561191 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.561347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.561526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.561714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.561714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.562002 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.562193 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.562371 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.566084 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.566329 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.566498 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.568504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.568691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.568858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.569038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.569199 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.569357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.569511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.569660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.569825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.569987 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.570184 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.570351 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.570509 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.570656 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.570819 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.570976 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.570976 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.571320 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790535-39-iscsi {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.572305 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.572476 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.572632 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.572786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.572983 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.573146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.573303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.573303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.573590 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.573748 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.574185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.574345 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.574504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.574649 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.574795 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.574955 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.575127 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.575273 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.575425 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.575576 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.575730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.575886 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.576031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.576176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.576326 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.576517 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.576679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.576835 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.576981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.577147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.577300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.577451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.577604 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.577761 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.577901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.578017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.578017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.582449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.582626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.582626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.582929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.582929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.583311 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.583463 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.583618 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.583618 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.583901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.584276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.584439 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.584629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.584799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.584958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.585104 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.585250 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.585413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.585578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.585724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.585878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.586693 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.586898 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.586995 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.587094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587238 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.587373 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.587548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.588096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.588264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.588354 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.588439 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.588518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.588638 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.588728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.588827 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.588920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.589013 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.589106 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.589197 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.589292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.589389 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.589475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.589558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.589642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.589735 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.589735 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.589912 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.589997 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.590087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.590275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590444 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.590528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.591832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.592945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.593561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.593561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.593561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.593561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.593561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.594086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.594086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.594932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.595173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.595491 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.595817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.596198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.596509 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.596828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.598579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.599093 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.599779 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.601677 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.601677 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.601930 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.602501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.602606 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.602689 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.602788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.602880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.602880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.603053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.603053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.603358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.603560 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.603693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.604052 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.604159 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.604409 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.604552 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.604736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.604933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.605079 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.605403 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.605505 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.605744 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.605917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.606104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.606389 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.606580 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.606750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.606907 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.607059 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.607315 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.607507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.607681 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.607872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.608034 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.608223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.608519 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.608695 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.608856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.609109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.609228 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.609443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.609539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.609768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.609869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.610755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.610850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.611087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.611172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.611400 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.611482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.611715 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.611806 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.612051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.612134 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.612544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.612667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.612766 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.612926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.613115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.613284 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.613442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.613611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.613769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.613949 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.614426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.614604 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.614766 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.614948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.615108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.615273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.615433 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.615583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.615761 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.615934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.616088 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.616247 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.616384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.616477 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.616582 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.616675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.616768 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.616858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.616950 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.617035 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.617134 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.617346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.617442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.617665 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.617758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.617979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.618177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.618330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.618422 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.619728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.619822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.619897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.619982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.620057 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.620134 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.620206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.620283 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.620283 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.620434 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.620513 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.620592 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.620673 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.620752 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.620833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.620965 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.621133 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.621302 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.621450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.621644 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.621773 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.621967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.622088 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.622328 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.622450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.622784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.622893 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.623323 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.623461 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 15:20:25.623639 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.623816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.623959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.624164 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.624256 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.624523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.624612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.624851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.624957 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.625199 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.625565 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.625922 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.626272 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.626600 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.626941 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.627280 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.627606 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.627929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.628259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.628740 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.629088 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.629423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.629755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.630087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.630435 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.630768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.631114 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.631452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.631620 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.631785 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.631983 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.632139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.632330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.632497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.632871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.632977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.633061 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.633269 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.633355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.633612 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.633695 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.633972 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.634081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.634332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.634464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.635783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.635892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.635978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636508 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636603 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636775 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.636943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.637027 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.637183 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.637308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.637515 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.637633 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.637878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.637995 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639061 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639191 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639359 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639440 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.639953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.640047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.640179 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.640366 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.640485 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.640683 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.640806 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.641000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.641129 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.641344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.641488 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.641673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.641849 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.641989 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.642207 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.642345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.642529 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.642686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.642993 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.643105 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.643202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.643456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.643557 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.643781 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.643884 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.644105 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.644205 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.644437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.644540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.644771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.644880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.645098 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.645199 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.645419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.645520 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.645740 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.645847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.646059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.646240 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.646411 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.646512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.646733 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.646853 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.647053 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.647161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.647372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.647464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.647687 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.647778 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.648002 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.648086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.648316 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.648415 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.648633 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.648727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.648959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.649093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.649283 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.649549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.649660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.649892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.649998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.650245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.650343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.650565 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.650660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.650894 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.650988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.651225 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.651319 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.651543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.651637 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.651888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.651989 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.652242 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.652344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.652560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.652662 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.652881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.653058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.653270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.653367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.653500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.653671 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.653820 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.653993 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.654209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.654334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.654471 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.654658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.654787 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.654975 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.655115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.655288 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.655406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.655602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.655723 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.655917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.656020 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.656233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.656328 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.656569 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.656680 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.657409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.657508 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.657727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.657820 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.658043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.658160 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.658386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.658492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.658741 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.658889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.659055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.659158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.659364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.659456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.659677 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.659914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.660044 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.660300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.660414 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.660596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.660691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.660922 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.661032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.661251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.661346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.661573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.661674 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.661897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.662002 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.662251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.662348 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.662564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.662667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.662877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.662980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.663189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.663296 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.663507 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.663635 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.663821 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.664040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.664143 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.664384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.664485 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.664706 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.664813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.665037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.665132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.665359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.665514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.665656 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.665763 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.665979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.666072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.666319 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.666412 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.666643 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.666748 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.666959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.667051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.667270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.667363 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.667580 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.667686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.667896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.667990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.668213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.668314 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.668525 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.668619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.668843 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.668942 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.669150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.669242 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.669475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.669570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.669787 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.669881 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.670097 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.670230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.670434 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.670529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.670754 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.670855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.671070 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.671163 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.671382 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.671475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.671708 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.671808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.672026 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.672134 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.672339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.672531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.672793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.672907 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.673353 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.673529 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.673680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.673779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.673861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.674048 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.674197 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.674889 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.675001 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.675233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.675342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.675567 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.675685 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.675884 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.675992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.676213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.676329 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.676527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.676647 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.676844 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.677154 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678284 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678492 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678570 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678650 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678724 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678724 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678869 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.678997 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.679127 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.679318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.679448 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.679635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.679784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.679948 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.680125 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.680261 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.680455 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.680564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.680891 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.680985 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.681208 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.681301 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.681533 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.681621 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.681864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.681957 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.682204 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.682298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.682534 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.682625 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.682856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.682949 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.683175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.683281 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.683514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.683638 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.683809 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.683908 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.684116 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.684217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.684439 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.684545 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.684758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.684858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.685078 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.685177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.685391 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.685578 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.685801 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.685905 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.686032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.686150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.686374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.686480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.686709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.686811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.687038 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.687131 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.687357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.687465 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.687673 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.687767 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.687995 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.688127 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.688345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.688449 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.688670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.688798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.688998 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.689097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.689318 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.689424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.689635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.689730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.690027 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.690180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.690278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.690354 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.690597 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.690718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.690920 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.691032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.691237 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.691516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.691614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.691860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.691955 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.692173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.692294 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.692510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.692610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.692825 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.692928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.693138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.693244 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.693459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.693595 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.693775 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.693896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.694093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.694295 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.694478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.694584 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.694799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.694933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.695166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.695268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.695487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.695641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.695811 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.695903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.696130 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.696231 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.696444 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.696549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.696759 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.696858 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.697079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.697188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.697388 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.697495 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.697700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.697830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.698014 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.698108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.698354 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.705769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.705907 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.705989 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706063 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706242 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706350 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706725 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706851 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.706990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707359 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707452 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707734 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.707860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708010 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708110 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708301 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708546 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.708920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709380 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.709994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710314 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710581 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710766 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710865 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.710953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711038 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711216 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711491 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711751 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.711933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712027 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712114 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712114 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712453 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712537 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.712930 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713018 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713103 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713431 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713526 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713638 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.713959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714106 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714431 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714895 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.714980 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715064 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715148 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715227 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715326 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715507 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715687 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715779 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.715983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716220 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716293 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716363 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716456 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716637 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716722 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716806 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.716986 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.717120 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.717215 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.717288 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.717416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.717551 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.717728 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.717865 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.718078 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.718215 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.718420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.718525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.718749 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.718850 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.719087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.719180 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.719914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.720014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.720249 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.720387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.720586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.720729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.720922 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.721054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.721245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.721395 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.721571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.721667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.721902 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.721999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.722243 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.722349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.722556 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.722652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.722874 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.723017 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.723185 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.723334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.723495 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.723659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.723806 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.723990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.724120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.724313 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.724432 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.724639 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.724733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.724967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.725069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.725285 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.725386 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.725646 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.725790 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.725976 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.726085 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.726320 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.726429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.726630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.726731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.726940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.727042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.727249 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.727345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.727595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.727709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.727907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.728058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.728239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.728333 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.728558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.728696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.728887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.728989 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.729202 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.729295 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.729524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.729629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.729856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.729959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.730338 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.734953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.734953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.735690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.735690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.735872 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.735960 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736450 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736534 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736624 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736710 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736802 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.736992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737260 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737792 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.737973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738257 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738508 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.738965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739153 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739253 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739341 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739434 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739519 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739666 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739756 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739829 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.739971 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740309 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740381 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740605 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740746 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.740914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.741048 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.741209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.741417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.741520 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.741743 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.741859 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.742062 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.742199 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.742420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.742523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.742736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.742838 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.743065 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.743211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.743382 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.743528 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.743702 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.743860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.744024 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.744291 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.744386 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.744618 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.744719 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.744936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.745033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.745264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.745358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.745585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.745688 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.745917 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.746014 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.746325 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.746507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.746637 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.746771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.746939 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.747073 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.747261 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.747395 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.747584 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.747721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.748369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.748501 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.748690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.748792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.749031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.749186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.749351 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.749453 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.749679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.749774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.749997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.750104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.750346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.750439 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.750706 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.750803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.751024 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.751132 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.751339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.751441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.751660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.751854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.751980 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.752197 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.752299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.752520 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.752622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.752855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.753001 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.753191 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.753290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.753509 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.753612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.753827 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.753933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.754223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.754401 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.754510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.754763 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.754858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.755093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.755189 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.755405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.755504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.755729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.755834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.756051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.756147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.756370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.756472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.756682 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.756792 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.756999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.757092 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.757309 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.757408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.757632 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.757738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.757948 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.758041 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.758286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.758395 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.758605 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.758713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.758927 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.759059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.759248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.759351 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.759563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.759658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.759926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.760068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.760195 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.760311 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.760516 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.760648 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.760830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.760963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.761142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.761265 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.761456 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.761589 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762664 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762741 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762898 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.762980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.763067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.763166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.763294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.763456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.763606 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.763782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.763923 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.764111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.764234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.764447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.764600 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.764760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.764908 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.765073 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.765169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.765394 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.765490 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.765709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.765819 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.766024 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.766170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.766383 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.766478 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.766705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.766854 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.767020 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.767119 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.767331 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.767424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.767641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.767751 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.767975 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.768113 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.768289 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.768383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.768635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.768777 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.768962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.769175 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.769279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.769516 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.769620 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.769845 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.769948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.770209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775181 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775506 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775688 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775781 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.775973 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776249 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776438 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776785 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.776967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777063 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777159 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777604 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.777917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778023 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778262 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778875 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.778962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779141 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779234 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779517 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779688 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.779959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780141 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780242 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780338 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780688 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780782 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780882 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.780972 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.781046 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.781130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.781223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.781317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.781415 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.781503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.781595 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.782417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.782530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.782631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.782719 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.782811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.782811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.782966 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.783049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.783136 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.783210 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.783362 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.783487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.783689 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.783824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.784009 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.784168 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.784336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.784507 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.784667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.784844 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.784990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.785158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.785313 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.785470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.785634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.785781 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.785959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.786098 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.786310 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.786461 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.786748 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.786851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.787065 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.787168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.787377 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.787480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.787694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.787791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.788006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.788107 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.788316 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.788458 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.788627 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.788755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.788935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.789079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.789250 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.789404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.789560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.789730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.789881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.790245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.790357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.790561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.790658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.790870 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.790966 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.791180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.791285 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.791494 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.791599 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.791822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.791963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.792114 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.792216 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.792422 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.792519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.792729 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.792831 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.793038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.793154 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.793373 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.793477 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.793712 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.793807 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.794025 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.794181 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.794378 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.794473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.794696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.794810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.795017 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.795139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.795327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.795423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.795650 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.795751 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.795974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.796196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.796300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.796556 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.796650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.796883 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.796991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.797224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.797327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.798114 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.798257 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.798463 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.798611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.798783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.798877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.799097 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.799199 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.799414 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.799568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.799727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.799828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.800066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.800172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.800378 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.800484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.800712 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.800829 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.801042 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.801165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.801354 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.801451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.801672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.801766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.801986 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.802142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.802334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.802439 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.802649 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.802742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.802967 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.803069 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.803284 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.803385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.803597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.803698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.803908 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.804010 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.804226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.804317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.804540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.804633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.804855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.804962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.805171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.805278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.805484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.805586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.805805 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.805981 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.806118 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.806245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.806460 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.806567 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.806777 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.806885 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.807098 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.807201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.807420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.807520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.807738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.807833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.808086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.808178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.808400 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.808509 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.808649 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:20:25.808745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.809015 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.809337 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.809658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.809987 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.810332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.810653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.811008 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.811335 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.811880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.812227 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.812557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.812900 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.813267 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.813583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.813899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.814238 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.814574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.814895 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.815246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.815527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.815848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.816168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.816486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.816803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.817121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.817443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.817760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.818079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.818422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.818744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.819095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.819422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.819748 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.820074 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.820404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.820728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.821084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.821402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.821722 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.822046 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.822414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.822737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.823052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.826653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.827568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.827568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.827568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.827568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.827952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.827952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.828232 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.828556 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.829409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.829737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.830076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.830415 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.830743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.831052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.831373 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.831691 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.832004 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.832319 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.832631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.832832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:25.832935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.833244 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.833554 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.833867 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.834365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.834677 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.834999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.835313 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.835630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.835943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.836259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.836665 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.836882 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.837235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.837580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.837906 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.838377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.838710 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.839047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.839418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.839699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.840109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.840441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.840761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.841105 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.841428 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.841751 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.842075 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.842426 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.842750 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.843071 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.843408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.843742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.844057 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.845059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.845459 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.845795 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.846139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.846465 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.846806 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.847123 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.847453 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.847776 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.848097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.848416 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.848743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.849070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.849408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.849742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.850061 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.850424 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.850759 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.851119 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.851444 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.851801 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.852140 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.852467 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.852790 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.853107 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 15:20:25.853358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 15:20:25.876932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:25.897666 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.context [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),766bbfc3-40e3-4ccb-a93d-d8426b092689(cell1) {{(pid=117616) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:20:25.902076 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.903749 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.904555 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.906518 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.917932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:25.921556 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:25.941852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.context [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),766bbfc3-40e3-4ccb-a93d-d8426b092689(cell1) {{(pid=117615) load_cells /opt/stack/nova/nova/context.py:464}} May 16 15:20:25.950531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.950531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.950531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:20:25.950845 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:20:25.963482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:25.965788 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:26.085529 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_db.sqlalchemy.engines [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:26.130498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_db.sqlalchemy.engines [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 15:20:26.406957 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:20:26.414602 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:20:26.465636 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:20:26.473747 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:20:26.761159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:20:26.767407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: WARNING keystonemiddleware.auth_token [None req-1c366c3d-cf11-4bab-828f-e7513ac7bddc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:20:26.773234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8bc5a69c0 pid: 117616 (default app) May 16 15:20:26.819478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 16 15:20:26.825829 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: WARNING keystonemiddleware.auth_token [None req-341622e3-8c26-4a9d-a935-d61fc95654d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 16 15:20:26.831097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8bc5a69c0 pid: 117615 (default app) May 16 15:21:10.557193 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9c8dd140-a51b-4e1b-b698-56d1d556fd18 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Action: 'create', calling method: .version_select at 0x7fddc1d46280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-133941897", "metadata": {"Type": "work"}}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:10.915334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2144117323", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "networks": [{"uuid": "691dcd6b-8dbe-4ba0-957f-a9ae8fc2125c"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:11.215264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] validate_networks() for [('691dcd6b-8dbe-4ba0-957f-a9ae8fc2125c', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:12.044325 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9c8dd140-a51b-4e1b-b698-56d1d556fd18 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.402659 May 16 15:21:12.045286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1155 bytes} [Mon May 16 15:21:09 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 15:21:12.058087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d413b2b-5aee-4a7d-b0ce-54775ffa47cd tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Calling method '.version_select at 0x7fddc1b9c280>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:12.215001 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8d413b2b-5aee-4a7d-b0ce-54775ffa47cd tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0" status: 200 len: 352 microversion: 2.1 time: 0.162018 May 16 15:21:12.215912 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 2/2] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:12 2022] GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:12.470184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f34cfa7a-9ee4-4703-a828-fd6be7053de5 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc1b9c4c0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:12.554714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f34cfa7a-9ee4-4703-a828-fd6be7053de5 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/276652ef-3220-42fa-afda-e557db3daccc" status: 200 len: 350 microversion: 2.1 time: 0.089297 May 16 15:21:12.555679 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 3/3] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:12 2022] GET /compute/v2.1/os-volumes/276652ef-3220-42fa-afda-e557db3daccc => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:12.733290 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:12.733985 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:12.734834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:12.735440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:12.735860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:12.768684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.769723 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:12.770731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:12.771333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:12.848715 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Getting quotas for project 3733b202412047fa87928b2a71871f5e. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:12.856049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Getting quotas for user 6da6d35c6c78443ba0319643a5e219d9 and project 3733b202412047fa87928b2a71871f5e. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:12.868976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:12.874716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:13.047967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c90d517d-8103-4e1e-81f5-3bd6eaad292b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.838660 May 16 15:21:13.051775 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 1/4] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:21:13.059736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-426e888b-0f6c-434f-b497-fa817731df47 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:13.062296 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-426e888b-0f6c-434f-b497-fa817731df47 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:13.229013 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5eaace5-bb09-4a06-b4c6-8cadfd517434 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Calling method '.version_select at 0x7fddc1b4c280>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:13.413191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-426e888b-0f6c-434f-b497-fa817731df47 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:13.445174 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-426e888b-0f6c-434f-b497-fa817731df47 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1215 microversion: 2.1 time: 0.389329 May 16 15:21:13.448795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 4/5] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:13 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:13.458279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d5eaace5-bb09-4a06-b4c6-8cadfd517434 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0" status: 200 len: 353 microversion: 2.1 time: 0.233081 May 16 15:21:13.459499 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 2/6] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:13 2022] GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0 => generated 353 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:13.472131 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f039a5e-fec5-46f2-9c55-500e2b6dfb48 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Calling method '.version_select at 0x7fddc1b60c10>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:13.837189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f039a5e-fec5-46f2-9c55-500e2b6dfb48 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0" status: 200 len: 353 microversion: 2.1 time: 0.091666 May 16 15:21:13.837189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 5/7] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:13 2022] GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:13.841279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fbdd4841-8f4f-4e30-9a60-131d9aefcac5 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Calling method '.version_select at 0x7fddc0aabe50>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:14.032186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fbdd4841-8f4f-4e30-9a60-131d9aefcac5 tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0" status: 202 len: 0 microversion: 2.1 time: 0.458971 May 16 15:21:14.032896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 3/8] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:21:13 2022] DELETE /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:21:14.041779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a5166c68-2de0-40a8-a64c-36aace77a26d tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Calling method '.version_select at 0x7fddc1b670d0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:14.128112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a5166c68-2de0-40a8-a64c-36aace77a26d tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0" status: 200 len: 352 microversion: 2.1 time: 0.088917 May 16 15:21:14.131603 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 6/9] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:14 2022] GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:14.448480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-caef5ee5-73b8-47e0-90bd-96f0c80fd831 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc0ab3550>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:14.465413 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3335b2c6-9abd-4743-8fbb-ae8ba8de73f2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:14.466241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3335b2c6-9abd-4743-8fbb-ae8ba8de73f2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:14.547899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-caef5ee5-73b8-47e0-90bd-96f0c80fd831 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/c86c9d16-ceab-4fe2-90d6-3d35e140da0f" status: 200 len: 349 microversion: 2.1 time: 0.103548 May 16 15:21:14.554160 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 4/10] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:14 2022] GET /compute/v2.1/os-volumes/c86c9d16-ceab-4fe2-90d6-3d35e140da0f => generated 349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:14.665859 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3335b2c6-9abd-4743-8fbb-ae8ba8de73f2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:14.676941 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3335b2c6-9abd-4743-8fbb-ae8ba8de73f2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1215 microversion: 2.1 time: 0.216242 May 16 15:21:14.682834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 7/11] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:14 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:15.143373 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8eed5538-c221-451b-9101-69cdfdfc47bc tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Calling method '.version_select at 0x7fddc1b4c9d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:15.215377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-8eed5538-c221-451b-9101-69cdfdfc47bc tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] HTTP exception thrown: Volume 3250fd73-d27e-48fc-8a78-36c3c970a4c0 could not be found. May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8eed5538-c221-451b-9101-69cdfdfc47bc tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Request method failure captured: May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0 HTTP/1.1 May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmvlDe-TogwXJgQ9PTFHYig-x-d-oNrH5UXdz47huwjiaTshqy8W-SFbojFf97AFrlSiHzU46bs0giN1_VQTC54muTvuw1cA7n1RmSuw9AdhOQFpz-ie8UIfWXYMfDV2DsisWjIml3nk2xmQy67ZbHtZNzDJu7kxTHbLIYKfXGqwSCY May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 22a3cb5588d9482389dcef1c48aabe67 May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesGetTestJSON-1608404226 May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:21:15.220709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/22a3cb5588d9482389dcef1c48aabe67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_22a3cb5588d9482389dcef1c48aabe67", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/22a3cb5588d9482389dcef1c48aabe67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/22a3cb5588d9482389dcef1c48aabe67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesGetTestJSON-1608404226 May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 22a3cb5588d9482389dcef1c48aabe67 May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesGetTestJSON-1608404226 May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesGetTestJSON-1608404226-project May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 78a021cbb2fd40d5a9447a7da1141008 May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesGetTestJSON-1608404226-project May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Volume 3250fd73-d27e-48fc-8a78-36c3c970a4c0 could not be found. May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '3250fd73-d27e-48fc-8a78-36c3c970a4c0'} May 16 15:21:15.222067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3250fd73-d27e-48fc-8a78-36c3c970a4c0 could not be found. (HTTP 404) (Request-ID: req-2ee13f08-7d1c-451e-9d41-38d90b371bb9) May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:15.222947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:21:15.224117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3250fd73-d27e-48fc-8a78-36c3c970a4c0 could not be found. May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:21:15.225255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3250fd73-d27e-48fc-8a78-36c3c970a4c0 could not be found. May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3250fd73-d27e-48fc-8a78-36c3c970a4c0 could not be found. May 16 15:21:15.226258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:21:15.227170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8eed5538-c221-451b-9101-69cdfdfc47bc tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] Returning 404 to user: Volume 3250fd73-d27e-48fc-8a78-36c3c970a4c0 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:21:15.228132 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8eed5538-c221-451b-9101-69cdfdfc47bc tempest-VolumesGetTestJSON-1608404226 tempest-VolumesGetTestJSON-1608404226-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0" status: 404 len: 109 microversion: 2.1 time: 0.089108 May 16 15:21:15.231155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 5/12] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:15 2022] GET /compute/v2.1/os-volumes/3250fd73-d27e-48fc-8a78-36c3c970a4c0 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:21:15.699556 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:15.700173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:15.709936 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:15.711982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:15.711982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:15.711982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:16.074424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:16.090301 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-155816f4-d35d-4770-906f-fd111d5848a6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1219 microversion: 2.1 time: 0.394435 May 16 15:21:16.100204 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 8/13] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:15 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1219 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:16.653768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d226866e-7eaa-4b0c-84c6-8dc7aac6a120 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc25739d0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:16.765441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d226866e-7eaa-4b0c-84c6-8dc7aac6a120 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/2785eab5-c343-442e-a2c9-e92bd582d611" status: 200 len: 350 microversion: 2.1 time: 0.116076 May 16 15:21:16.767955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 6/14] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:21:16 2022] GET /compute/v2.1/os-volumes/2785eab5-c343-442e-a2c9-e92bd582d611 => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:16.780861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6c1934ea-bf50-47bd-b770-ac2dcdf0eb8a tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc1aea8b0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.050200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6c1934ea-bf50-47bd-b770-ac2dcdf0eb8a tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.274506 May 16 15:21:17.050795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 9/15] 10.222.0.76 () {58 vars in 1133 bytes} [Mon May 16 15:21:16 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:17.066194 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-21ebd110-c067-4309-8eb4-69c065600bab tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc0a87430>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.113280 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.113900 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:17.141250 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:17.141720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:17.146446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:17.147197 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:17.241124 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-21ebd110-c067-4309-8eb4-69c065600bab tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.178174 May 16 15:21:17.241274 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 7/16] 10.222.0.76 () {58 vars in 1148 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:17.257612 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26b56d97-0724-471c-9f40-6cf257e0e886 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc0a87e50>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.450475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:17.454851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26b56d97-0724-471c-9f40-6cf257e0e886 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.202640 May 16 15:21:17.461398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4a0ad5bb-96e0-4134-89fc-c0b07ab13fb9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1267 microversion: 2.1 time: 0.352125 May 16 15:21:17.461956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 8/17] 10.222.0.76 () {58 vars in 1133 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:17.470900 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf4f012c-b419-4fa5-82d4-181842b66cfe tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc0a16af0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.483398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 10/18] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:17.672659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cf4f012c-b419-4fa5-82d4-181842b66cfe tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.208556 May 16 15:21:17.673972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 9/19] 10.222.0.76 () {58 vars in 1166 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:17.690008 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1beaeb85-5102-4500-8113-1c93b289418d tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc1afc700>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:17.911609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1beaeb85-5102-4500-8113-1c93b289418d tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.229276 May 16 15:21:17.912448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 11/20] 10.222.0.76 () {58 vars in 1169 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:17.925847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-551485b2-737a-41cb-9f08-de17fa7a532e tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc0a168b0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:18.174490 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-551485b2-737a-41cb-9f08-de17fa7a532e tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.253987 May 16 15:21:18.175460 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 10/21] 10.222.0.76 () {58 vars in 1154 bytes} [Mon May 16 15:21:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:18.189020 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-97c3ff76-3e98-4130-9091-ce4044b81648 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc1aa7e50>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:18.350851 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-97c3ff76-3e98-4130-9091-ce4044b81648 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.165912 May 16 15:21:18.350851 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 12/22] 10.222.0.76 () {58 vars in 1187 bytes} [Mon May 16 15:21:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:18.361760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a27f6935-b6b7-4c93-8bfe-352d14e9b353 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] Calling method '.version_select at 0x7fddc0a87c10>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:18.499748 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:18.500988 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:18.510906 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a27f6935-b6b7-4c93-8bfe-352d14e9b353 tempest-VolumesTestJSON-2033790258 tempest-VolumesTestJSON-2033790258-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.153422 May 16 15:21:18.523319 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 11/23] 10.222.0.76 () {58 vars in 1154 bytes} [Mon May 16 15:21:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:18.526971 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:18.527600 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:18.528459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:18.528971 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:18.732170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:18.744680 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f261aada-2cac-4374-9b57-68ad543fc6d6 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1273 microversion: 2.1 time: 0.250360 May 16 15:21:18.745595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 13/24] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:18 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:19.768694 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:19.770793 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:19.790606 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.791255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:19.792337 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:19.794343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:20.813336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:20.852429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-14815b0c-4504-4873-9112-9f6911f7841d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1273 microversion: 2.1 time: 1.087642 May 16 15:21:20.855308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 12/25] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:19 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1273 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:21.872062 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:21.873609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:21.883209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.893558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:21.894974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:21.897130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:22.229060 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:22.239155 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9205dc2a-0cfc-4aba-8435-7d1ccd0dfc1e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1273 microversion: 2.1 time: 0.371596 May 16 15:21:22.244325 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 14/26] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:21 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1273 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:23.261233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:23.263293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:23.283691 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.284291 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:23.285151 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:23.287653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:24.025028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:24.050758 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5051e0de-850a-44bc-ac62-3dcb2b5f357f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.781681 May 16 15:21:24.063422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 13/27] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:23 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:25.071131 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:25.071741 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:25.087887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:25.088594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:25.089542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:25.094447 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:26.209992 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:26.243021 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-42eed30c-922f-420d-91ee-f1ea28845b8b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 1.175557 May 16 15:21:26.245275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 15/28] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:25 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:27.210970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a2d586e6-de2a-4932-b637-d3783a1e02e8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'create', calling method: .version_select at 0x7fddc0968790>, body: {"keypair": {"name": "tempest-keypair-564473335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeANv1bqvrZv0QbczBsb2IQjHiHWPYjDMWJmRrDJES1QlOp4FYz2WLE1U145SykpxHuoLAEnfnWMdH4eMvox/vnN0Ljk8QdLy2NWZYTDC1hirST1mer5cg4TrbAvKwemg=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:27.260965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:27.262259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:27.269077 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.274069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.275341 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:27.277080 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:27.301527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a2d586e6-de2a-4932-b637-d3783a1e02e8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for project b360d85257f14f9191b490327c110ba8. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:27.317019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-a2d586e6-de2a-4932-b637-d3783a1e02e8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for user 6b16118d74774a9ea673d6e0532b8772 and project b360d85257f14f9191b490327c110ba8. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:27.511312 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a2d586e6-de2a-4932-b637-d3783a1e02e8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.935484 May 16 15:21:27.515244 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 14/29] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:21:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:28.055888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:28.063958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-902fe2f5-7ac8-4c47-9986-3ff3e9575535 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.806817 May 16 15:21:28.064839 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 16/30] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:27 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:29.080964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:29.081559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:29.098929 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.099391 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:29.100270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:29.100643 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:29.704097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-88cc1ace-7737-4d72-9f22-ad637a3ee728 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'create', calling method: .version_select at 0x7fddc0976040>, body: {"keypair": {"name": "tempest-keypair-1050830964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9J4n2nszEGTIAvLtl+yyGoGHKScCyVmpFJQNyKwHVtIcCiylAkEkSNAoz+nWNqxiNVB0jV4y0bR7dw4OlFmgdPR7G0vzSzazwCVux/x0t0rfNPqD1jMXqD6JQzGmuHIg=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:29.736504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-88cc1ace-7737-4d72-9f22-ad637a3ee728 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for project f2241c9641bb401aa9f1c6930c513552. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:29.748170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-88cc1ace-7737-4d72-9f22-ad637a3ee728 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for user d3492cec550a46598e09c48474a4c6fb and project f2241c9641bb401aa9f1c6930c513552. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:29.844286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:29.852206 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d88290db-8604-4abd-b3b2-a708a85b9e5e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.775131 May 16 15:21:29.864385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 17/31] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:29 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:29.932959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-88cc1ace-7737-4d72-9f22-ad637a3ee728 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.106674 May 16 15:21:29.933869 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 15/32] 10.222.0.76 () {62 vars in 1199 bytes} [Mon May 16 15:21:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 15:21:30.883068 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:30.883840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:30.902824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:30.905440 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:30.913987 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:30.915619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:31.595326 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:31.602738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-21d66fb7-6b65-4de9-b4c3-05f23897e90c tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.725616 May 16 15:21:31.613615 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 18/33] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:30 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:32.022373 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-9dda33c0-c3ab-40e0-ac85-f06be7acf2ed req-00a4d558-0f8f-4d79-84c0-34b46aacce93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "426beb7e-b95a-4ede-a2e0-d28d28123018", "tag": "b89d0803-a75d-4e81-8ba8-81628dc521e2"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:32.056928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9dda33c0-c3ab-40e0-ac85-f06be7acf2ed req-00a4d558-0f8f-4d79-84c0-34b46aacce93 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.061079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9dda33c0-c3ab-40e0-ac85-f06be7acf2ed req-00a4d558-0f8f-4d79-84c0-34b46aacce93 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.107944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-9dda33c0-c3ab-40e0-ac85-f06be7acf2ed req-00a4d558-0f8f-4d79-84c0-34b46aacce93 service nova] Creating event network-changed:b89d0803-a75d-4e81-8ba8-81628dc521e2 for instance 426beb7e-b95a-4ede-a2e0-d28d28123018 on hv-cinder-79053 May 16 15:21:32.114673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9dda33c0-c3ab-40e0-ac85-f06be7acf2ed req-00a4d558-0f8f-4d79-84c0-34b46aacce93 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 15:21:32.122079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe6a2d54-79a6-4a93-9137-2da5c7992464 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.124597 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe6a2d54-79a6-4a93-9137-2da5c7992464 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.128196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe6a2d54-79a6-4a93-9137-2da5c7992464 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.129024 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe6a2d54-79a6-4a93-9137-2da5c7992464 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.159477 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.compute.rpcapi [None req-fe6a2d54-79a6-4a93-9137-2da5c7992464 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 15:21:32.160512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe6a2d54-79a6-4a93-9137-2da5c7992464 None None] Releasing lock "compute-rpcapi-router" {{(pid=117615) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 15:21:32.224584 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fe6a2d54-79a6-4a93-9137-2da5c7992464 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.007636 May 16 15:21:32.225815 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 16/34] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:32.620212 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:32.621117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:32.630376 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.639399 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:32.640254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:32.640703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:33.300755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:33.321580 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-330638478", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:33.347237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7d08401f-371c-417f-9fb8-d6263d8e72b7 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.731080 May 16 15:21:33.350511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 17/35] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:32 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:33.593383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] validate_networks() for [('c04e7fee-d98e-4604-82f3-3cc633c866f1', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:34.365902 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:34.367393 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:34.378789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.378789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.378789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:34.383503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:34.725722 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:34.737513 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3559c020-c8cb-4061-a1b0-3f42e80f8195 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.375320 May 16 15:21:34.755956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 18/36] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:34 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:34.949706 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-747647454", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85d31a74-2e0d-4761-a3e9-16256afe83d7"}], "security_groups": [{"name": "tempest-securitygroup--342159553"}], "key_name": "tempest-keypair-564473335", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:35.223660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] validate_networks() for [('85d31a74-2e0d-4761-a3e9-16256afe83d7', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:35.931997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:35.933044 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:35.933044 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:35.933044 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:35.933506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:35.961058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.961550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:35.962409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:35.962854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.009194 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for project b360d85257f14f9191b490327c110ba8. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:36.017730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for user 6b16118d74774a9ea673d6e0532b8772 and project b360d85257f14f9191b490327c110ba8. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:36.036005 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:36.038666 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:36.242539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4b69b723-86bf-4840-9292-a86e209c8f19 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.298034 May 16 15:21:36.249776 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 19/37] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:21:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:21:36.257224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:36.258178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:36.287726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.289524 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.290994 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.293660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.459143 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:36.459669 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:36.460718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:36.461134 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:36.461542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:36.499642 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.500251 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.501182 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:36.504994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:36.629232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for project c3c3d75e638a4871b548ba689eeddeda. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:36.655355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for user 6c6b9438bb4245b3908664bfece4ef22 and project c3c3d75e638a4871b548ba689eeddeda. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:36.687691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:36.695920 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:36.834161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:36.848420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-921f181d-2f62-4f7b-afe9-609e5e8735fa tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.597063 May 16 15:21:36.855161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 20/38] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:36 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:36.872161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3258ca40-4bdd-4807-8af7-f903d6b3ad67 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:36.879850 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3258ca40-4bdd-4807-8af7-f903d6b3ad67 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:36.940158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f821dd0a-553e-4e91-9ec4-c822f59fdb3f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.604699 May 16 15:21:36.947069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 19/39] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:21:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 4612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:21:36.958647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-81c6aca5-dbd5-43c6-84bb-27a71d2d77ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:36.960362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-81c6aca5-dbd5-43c6-84bb-27a71d2d77ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:37.112690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-81c6aca5-dbd5-43c6-84bb-27a71d2d77ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:37.121415 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-81c6aca5-dbd5-43c6-84bb-27a71d2d77ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1221 microversion: 2.1 time: 0.166025 May 16 15:21:37.124877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 20/40] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:36 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1221 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:37.143511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3258ca40-4bdd-4807-8af7-f903d6b3ad67 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:37.157358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3258ca40-4bdd-4807-8af7-f903d6b3ad67 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1236 microversion: 2.1 time: 0.300596 May 16 15:21:37.172683 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 21/41] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:36 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1236 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:37.479370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1381814587", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:37.561341 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] validate_networks() for [('c04e7fee-d98e-4604-82f3-3cc633c866f1', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:37.874684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:37.875343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:37.885019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.885483 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:37.887152 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:37.887659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.172297 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:38.180619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:38.180619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:38.180619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:38.180619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:38.189332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.190647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.191891 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:38.192610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:38.207570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.214264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for project c3c3d75e638a4871b548ba689eeddeda. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:38.221190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for user 6c6b9438bb4245b3908664bfece4ef22 and project c3c3d75e638a4871b548ba689eeddeda. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:38.221884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b5ce572c-f110-40bc-8295-3ef6571832ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.351566 May 16 15:21:38.226782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 22/42] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:37 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:38.235217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1177771350", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ca0b759-8171-48eb-a5a7-1c280cfa9338"}], "security_groups": [{"name": "tempest-securitygroup--1007926190"}], "key_name": "tempest-keypair-1050830964", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:38.260228 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:38.270497 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:38.417219 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] validate_networks() for [('6ca0b759-8171-48eb-a5a7-1c280cfa9338', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:21:38.543645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-63693cc2-715b-4839-8f50-80a2a4829d86 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.069504 May 16 15:21:38.549227 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 21/43] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:21:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:21:38.554855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-036c1592-24b8-4811-a5da-1e450c97143e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:38.555650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-036c1592-24b8-4811-a5da-1e450c97143e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:38.630492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-036c1592-24b8-4811-a5da-1e450c97143e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.639290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-036c1592-24b8-4811-a5da-1e450c97143e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1236 microversion: 2.1 time: 0.087468 May 16 15:21:38.640496 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 22/44] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:38 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:38.645788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-60775869-057b-4465-849b-168da8835b07 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:38.646699 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-60775869-057b-4465-849b-168da8835b07 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:38.735142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-60775869-057b-4465-849b-168da8835b07 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:38.751784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-60775869-057b-4465-849b-168da8835b07 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1222 microversion: 2.1 time: 0.108406 May 16 15:21:38.753067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 23/45] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:38 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:39.130990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:21:39.131636 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:21:39.133355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:21:39.133355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:21:39.133355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:21:39.164581 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.165474 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.166513 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.167021 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.196450 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for project f2241c9641bb401aa9f1c6930c513552. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:21:39.200190 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for user d3492cec550a46598e09c48474a4c6fb and project f2241c9641bb401aa9f1c6930c513552. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:21:39.212660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:21:39.217337 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:21:39.246370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.248575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.255625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.256160 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.257009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.257512 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.533720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.565579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0d673dd3-8564-4f92-bd89-7cd7087c0224 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.323574 May 16 15:21:39.578855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 24/46] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:39 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:39.594968 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c9ec9d88-d386-4539-8dc4-7c26a365af3d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.371080 May 16 15:21:39.596858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 23/47] 10.222.0.76 () {62 vars in 1187 bytes} [Mon May 16 15:21:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 16 15:21:39.613186 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dbe2b0af-2d9c-4f5c-9a05-a77eb3b96ef9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.615161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dbe2b0af-2d9c-4f5c-9a05-a77eb3b96ef9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.659111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.664671 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.672441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.679446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.683294 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:39.684041 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:39.769372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dbe2b0af-2d9c-4f5c-9a05-a77eb3b96ef9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.777108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dbe2b0af-2d9c-4f5c-9a05-a77eb3b96ef9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.781251 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dbe2b0af-2d9c-4f5c-9a05-a77eb3b96ef9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.782701 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dbe2b0af-2d9c-4f5c-9a05-a77eb3b96ef9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1282 microversion: 2.20 time: 0.178593 May 16 15:21:39.783792 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 25/48] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:39 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:39.788628 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f2d7c780-928f-4d6f-b394-50de1e3324c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:39.789504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f2d7c780-928f-4d6f-b394-50de1e3324c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:39.805548 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.824926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6b11c796-ab30-4a5e-9e04-17cc71788037 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1232 microversion: 2.1 time: 0.170803 May 16 15:21:39.825569 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 24/49] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:39 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1232 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:39.926332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f2d7c780-928f-4d6f-b394-50de1e3324c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:39.933909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f2d7c780-928f-4d6f-b394-50de1e3324c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1222 microversion: 2.1 time: 0.148324 May 16 15:21:39.943786 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 26/50] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:39 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:40.582696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.583336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.589855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.590091 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.592762 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.593216 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.739438 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:40.746090 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5ba92549-daf7-4f29-b387-fadc8e4b9e35 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.167322 May 16 15:21:40.746704 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 25/51] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:40.800876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4409d918-80f0-4ab6-b557-bc4d3497edaa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.801583 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4409d918-80f0-4ab6-b557-bc4d3497edaa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.842473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.843100 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.849312 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.849942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.850744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.851184 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.864218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4409d918-80f0-4ab6-b557-bc4d3497edaa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:40.871625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4409d918-80f0-4ab6-b557-bc4d3497edaa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:40.874281 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4409d918-80f0-4ab6-b557-bc4d3497edaa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:40.875396 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4409d918-80f0-4ab6-b557-bc4d3497edaa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1282 microversion: 2.20 time: 0.078468 May 16 15:21:40.875993 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 27/52] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:40.912826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:40.920831 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f390e9d1-5665-4cd8-af18-81f6f900bc2b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1288 microversion: 2.1 time: 0.082256 May 16 15:21:40.921425 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 26/53] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:40.949896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:40.950531 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:40.957227 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.957675 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:40.958709 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:40.959141 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.024334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:41.038292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9681d8ab-6b32-43e5-8b63-08b48e48f496 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1226 microversion: 2.1 time: 0.092031 May 16 15:21:41.038908 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 28/54] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:40 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:41.765028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:41.766364 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:41.773953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.774290 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.775096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:41.775540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:41.898856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-212bdefe-2073-4211-8406-9d0615d21532 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:41.900301 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-212bdefe-2073-4211-8406-9d0615d21532 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:41.993106 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-212bdefe-2073-4211-8406-9d0615d21532 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:42.007155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:42.008213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-212bdefe-2073-4211-8406-9d0615d21532 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:42.009840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-212bdefe-2073-4211-8406-9d0615d21532 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:42.016685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-212bdefe-2073-4211-8406-9d0615d21532 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1282 microversion: 2.20 time: 0.126908 May 16 15:21:42.018504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-06bf529d-6f7d-42fb-9608-14e7d8897f3d tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.257299 May 16 15:21:42.027003 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 29/55] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:41 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:42.029299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 27/56] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:41 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:42.033105 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:42.033894 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:42.040624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.041287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.042270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.042861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.055989 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:42.056766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:42.068986 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.069919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.072499 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:42.073796 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:42.148926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:42.161713 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7a98bd14-add0-4443-b046-9e9eb5016f14 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1296 microversion: 2.1 time: 0.132772 May 16 15:21:42.174278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 30/57] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:42 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1296 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:42.227074 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:42.236440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4c1ebd41-c300-47ca-a5fd-9fe7a6364927 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1274 microversion: 2.1 time: 0.184766 May 16 15:21:42.237809 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 28/58] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:42 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:43.035654 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:43.036185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:43.036530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:43.037284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:43.042676 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.043476 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.044557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.045187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.045443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.045654 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.048740 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.049346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.226177 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:43.235358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:43.237183 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:43.237600 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:43.238956 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3c33353b-61e0-40e4-af8c-5c02cfcaaae3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1334 microversion: 2.20 time: 0.207439 May 16 15:21:43.239878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 31/59] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:43 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1334 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:43.246375 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d34adfa2-50bf-479a-b8da-7d0bf597c12f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.214501 May 16 15:21:43.252503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 29/60] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:43 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:43.260912 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:43.261856 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:43.269417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.270136 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.271133 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.271716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.324129 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-17ff6c47-4ce8-46a4-811e-d69db87bea98 req-12e53841-ee5e-4da9-933d-d166fa216186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426beb7e-b95a-4ede-a2e0-d28d28123018", "name": "network-vif-plugged", "status": "completed", "tag": "b89d0803-a75d-4e81-8ba8-81628dc521e2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:43.338446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-17ff6c47-4ce8-46a4-811e-d69db87bea98 req-12e53841-ee5e-4da9-933d-d166fa216186 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.338446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-17ff6c47-4ce8-46a4-811e-d69db87bea98 req-12e53841-ee5e-4da9-933d-d166fa216186 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.346913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:43.355084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-094e43df-6a00-4b66-9be1-1bd48a007b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1294 microversion: 2.1 time: 0.104566 May 16 15:21:43.356307 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 30/61] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:43 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:43.357913 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-17ff6c47-4ce8-46a4-811e-d69db87bea98 req-12e53841-ee5e-4da9-933d-d166fa216186 service nova] Creating event network-vif-plugged:b89d0803-a75d-4e81-8ba8-81628dc521e2 for instance 426beb7e-b95a-4ede-a2e0-d28d28123018 on hv-cinder-79053 May 16 15:21:43.358511 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-17ff6c47-4ce8-46a4-811e-d69db87bea98 req-12e53841-ee5e-4da9-933d-d166fa216186 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 16 15:21:43.359779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f240275-f43a-42a4-8e07-daed995f40f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.360228 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f240275-f43a-42a4-8e07-daed995f40f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.361016 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f240275-f43a-42a4-8e07-daed995f40f3 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.362273 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f240275-f43a-42a4-8e07-daed995f40f3 None None] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.363228 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:43.363970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:43.370346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.371091 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.374816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:43.374816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:43.374998 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.compute.rpcapi [None req-1f240275-f43a-42a4-8e07-daed995f40f3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 16 15:21:43.375381 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f240275-f43a-42a4-8e07-daed995f40f3 None None] Releasing lock "compute-rpcapi-router" {{(pid=117616) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 16 15:21:43.391354 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1f240275-f43a-42a4-8e07-daed995f40f3 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150075 May 16 15:21:43.391965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 32/62] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:43.446767 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:43.454242 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-28cdb3e3-66ed-40e1-b583-f8bf6fc0fed8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1292 microversion: 2.1 time: 0.095997 May 16 15:21:43.454816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 31/63] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:43 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:44.264167 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:44.265032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:44.268814 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:44.269458 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:44.275843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.275843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.275843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.275843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.276111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.276111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.276449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.277096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.338930 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:44.346924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:44.348870 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:44.349955 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-680a568c-0153-4570-8823-aeafacc72d4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1334 microversion: 2.20 time: 0.090695 May 16 15:21:44.350780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 33/64] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:44 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:44.373233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:44.374396 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:44.380395 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.380840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.381605 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.382041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.484015 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:44.491279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-beb35d6e-3a16-453e-84b2-53d52280f0ae tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.226344 May 16 15:21:44.491855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 32/65] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:44 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:44.496723 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:44.498155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:44.504653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.505240 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.506021 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:44.506629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:44.525731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:44.533135 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3d51b668-6a27-41c4-9306-0bfbee21dc22 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.164208 May 16 15:21:44.533716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 34/66] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:44 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:44.582933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:44.590485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dd3cfceb-a50d-4d5e-aa81-eabe3e339a5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1292 microversion: 2.1 time: 0.097371 May 16 15:21:44.591093 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 33/67] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:44 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:45.378265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:45.378265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:45.382620 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.383147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.383994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.384504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.447861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:45.455984 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:45.457437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:45.458570 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ad4383b7-57fd-4a46-bf96-4361bf98d5cb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1334 microversion: 2.20 time: 0.088461 May 16 15:21:45.459138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 35/68] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:45 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:45.508639 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:45.509252 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:45.515125 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.515570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.516367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.516794 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.550453 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:45.551070 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:45.556984 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.557438 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.558242 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.558686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.689978 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:45.697202 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-69966570-5f52-4c11-bef0-749f5ab87d46 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.192350 May 16 15:21:45.697770 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 34/69] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:45 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:45.707528 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:45.707528 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:45.708613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.709097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.709867 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:45.710335 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:45.735234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:45.758683 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e4fce4d6-1849-41e3-844e-b6996c959f06 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.211897 May 16 15:21:45.760633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 36/70] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:45 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:45.780509 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:45.788257 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-14b844d4-7f4f-4408-b649-032bc8c4d141 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1292 microversion: 2.1 time: 0.089468 May 16 15:21:45.789073 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 35/71] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:45 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:46.475848 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:46.476463 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:46.482314 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.482773 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.486839 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.486839 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.604107 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:46.617462 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:46.630300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:46.630300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bfd73914-a173-4c6b-8608-4b6a13e6813e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1342 microversion: 2.20 time: 0.148300 May 16 15:21:46.630300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 37/72] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:46 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1342 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:46.715779 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:46.716390 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:46.734619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.735695 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.736722 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.737351 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.777185 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:46.778331 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:46.788681 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.789290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.790739 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.791369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.944928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:46.953936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1170c1fb-9fc4-461a-9993-d04601f8f9d4 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.243090 May 16 15:21:46.954549 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 36/73] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:46 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:46.968434 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:46.969234 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:46.976185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.976808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:46.977907 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:46.978712 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.053510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:47.061625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-01a1d0b3-b7e2-4fb3-909a-bd099ae8f928 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.289918 May 16 15:21:47.063020 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 38/74] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:46 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:47.165594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-6dfb9229-2909-413a-b325-be9eaa768921 req-373e7262-741d-4229-a68d-7f322b50bd7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca077d05-e39f-4ce2-ba17-bc13b0d34bb4", "tag": "28c42936-ecff-4e27-887a-edf723a14aa4"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:47.182463 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-6dfb9229-2909-413a-b325-be9eaa768921 req-373e7262-741d-4229-a68d-7f322b50bd7c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.182907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-6dfb9229-2909-413a-b325-be9eaa768921 req-373e7262-741d-4229-a68d-7f322b50bd7c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.203508 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-6dfb9229-2909-413a-b325-be9eaa768921 req-373e7262-741d-4229-a68d-7f322b50bd7c service nova] Creating event network-changed:28c42936-ecff-4e27-887a-edf723a14aa4 for instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 on hv-cinder-79053 May 16 15:21:47.223073 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-6dfb9229-2909-413a-b325-be9eaa768921 req-373e7262-741d-4229-a68d-7f322b50bd7c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061283 May 16 15:21:47.226706 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:47.231287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 39/75] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:47.239358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6616d319-7800-4db1-b437-c4850c183bdc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.274584 May 16 15:21:47.250719 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 37/76] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:46 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:47.642717 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:47.643447 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:47.650871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.651319 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.652095 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.652524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.724296 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:47.734768 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:47.736336 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:47.737592 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c7f0e82d-4118-4dfc-887b-d5f2183df27b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1342 microversion: 2.20 time: 0.101241 May 16 15:21:47.738329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 40/77] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:47 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:47.971231 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:47.971870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:47.979342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.979799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:47.980577 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:47.981277 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.080118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:48.081066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:48.087356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.087933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.088706 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.089130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.123105 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:48.130823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-92b89682-836e-45d2-ba28-49fcb61c3839 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.163403 May 16 15:21:48.136788 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 38/78] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:47 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:48.254433 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:48.256971 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:48.257722 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:48.260880 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-83d18799-a7f3-4106-812e-5dc93d0b72f4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.186767 May 16 15:21:48.265323 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.269965 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.271151 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.271613 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 41/79] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:48 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:48.272495 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.411206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:48.418547 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-02d995b5-6c79-44af-b78b-cb474a947286 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.165573 May 16 15:21:48.419090 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 39/80] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:48 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:48.756044 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:48.756663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:48.762836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.763265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.764132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:48.764573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:48.861035 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:48.869960 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:48.871510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:48.872979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-61a7c1cb-b015-4351-85a6-e191f35229ba tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1342 microversion: 2.20 time: 0.120853 May 16 15:21:48.874357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 42/81] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:48 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1342 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:49.152362 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:49.152969 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:49.170654 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.171107 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.176297 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.176297 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.279102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:49.280167 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:49.287323 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.288195 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.289595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.290338 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.604400 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:49.614947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-50e62b5e-c2f5-4521-b476-7b1ed66c2ad0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.466387 May 16 15:21:49.615540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 40/82] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:49 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:49.626696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e56ce7f5-5772-488c-9f7b-44473730c4be req-b4171eb2-0d3c-4d58-8a9a-c40bc6fe034a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a560909-2499-4a61-8c4e-90438829ff82", "tag": "800fd8b6-f49e-4bc2-839c-1036a8769d6e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:49.645864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e56ce7f5-5772-488c-9f7b-44473730c4be req-b4171eb2-0d3c-4d58-8a9a-c40bc6fe034a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.647027 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e56ce7f5-5772-488c-9f7b-44473730c4be req-b4171eb2-0d3c-4d58-8a9a-c40bc6fe034a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.669542 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e56ce7f5-5772-488c-9f7b-44473730c4be req-b4171eb2-0d3c-4d58-8a9a-c40bc6fe034a service nova] Creating event network-changed:800fd8b6-f49e-4bc2-839c-1036a8769d6e for instance 5a560909-2499-4a61-8c4e-90438829ff82 on hv-cinder-79053 May 16 15:21:49.676779 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e56ce7f5-5772-488c-9f7b-44473730c4be req-b4171eb2-0d3c-4d58-8a9a-c40bc6fe034a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059759 May 16 15:21:49.677968 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 41/83] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:21:49.684006 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:49.687055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:49.698856 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.699915 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:49.701512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:49.702181 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.036169 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.048596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-98534b4a-784a-4349-bfb8-db8ad5d7c5ca tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.369182 May 16 15:21:50.051350 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 42/84] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:49 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:50.069041 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:50.069981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:50.080214 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:50.081826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.084680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:50.085465 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.197260 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.209089 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-81ee4b8f-c15a-411d-8fb9-ee440b5936ea tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.933752 May 16 15:21:50.221187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 43/85] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:49 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:50.227387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.243480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.245067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:50.246406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8cc982e-e605-4f6b-9727-b7b1bfa4346c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1340 microversion: 2.20 time: 0.190866 May 16 15:21:50.258018 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 43/86] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:50 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:50.632949 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:50.633554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:50.649673 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:50.650157 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.650943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:50.651544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.754057 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-c23600b7-d79a-4072-9467-8f158689ce33 req-6f295b2e-06e9-4550-8bd0-ce1135e45044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea", "tag": "24dcea07-8fae-4145-a733-6a29da9a079a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:50.770853 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c23600b7-d79a-4072-9467-8f158689ce33 req-6f295b2e-06e9-4550-8bd0-ce1135e45044 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:50.770853 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-c23600b7-d79a-4072-9467-8f158689ce33 req-6f295b2e-06e9-4550-8bd0-ce1135e45044 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:50.774182 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-c23600b7-d79a-4072-9467-8f158689ce33 req-6f295b2e-06e9-4550-8bd0-ce1135e45044 service nova] Creating event network-changed:24dcea07-8fae-4145-a733-6a29da9a079a for instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea on hv-cinder-79053 May 16 15:21:50.779048 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-c23600b7-d79a-4072-9467-8f158689ce33 req-6f295b2e-06e9-4550-8bd0-ce1135e45044 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103529 May 16 15:21:50.779870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 44/87] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:51.003401 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.011781 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7c396a61-e4c7-43f2-a910-18a35ce1ade0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.382765 May 16 15:21:51.012353 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 44/88] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:50 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:51.080431 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:51.081423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:51.087929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.088452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.089309 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.089874 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.228410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:51.229527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:51.239046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.239997 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.240945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.241557 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.287570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.308211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b6350166-10fb-40b9-b669-09c41205759a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.236998 May 16 15:21:51.310033 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 45/89] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:51 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:51.317161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:51.318825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:51.351317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.351792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.354952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:51.357174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:51.484165 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.494500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b235b71b-44c2-4591-85bc-569d5f4bedb5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.271067 May 16 15:21:51.495440 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 45/90] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:51 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:51.521966 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.534207 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.535706 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:51.536949 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-05ce5549-d881-4ef9-8f39-a582e6b3252f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.225585 May 16 15:21:51.537627 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 46/91] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:51 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:52.029112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:52.029721 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:52.035540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.035974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.036729 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.037161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.189180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:52.198348 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1c8eafdb-3e3c-428f-ace1-0c8e4792ffef tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.173500 May 16 15:21:52.199264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 46/92] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:52 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:52.325810 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:52.326446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:52.332292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.332729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.333480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.333908 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.468791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:52.475955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-52ba0c91-0fbe-4c85-872a-5f8dbf680469 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.154541 May 16 15:21:52.476510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 47/93] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:52 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:52.511906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:52.512566 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:52.518508 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.518958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.519721 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.520156 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.555201 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:52.555918 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:52.562487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.563014 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.563848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:52.564342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:52.667324 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:52.677132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-57dbe4d6-dcca-4bce-9f41-0d39702515e2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.168877 May 16 15:21:52.678055 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 47/94] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:52 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:52.724404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:52.732504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:52.733996 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:52.735335 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-def09829-4812-4f88-8948-e0c22a381e6a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.183890 May 16 15:21:52.735684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 48/95] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:52 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:53.216021 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:53.216633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:53.225529 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.226008 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.226813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.227256 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.361479 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:53.369067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cb6a9294-5f79-43b8-8df2-66121dac04d1 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.157456 May 16 15:21:53.369641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 48/96] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:53 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:53.493204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:53.493818 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:53.501741 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.502228 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.503027 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.503459 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.695107 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:53.696744 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:53.703406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.704096 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.705238 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.705677 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.707920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:53.725491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-47e39151-184e-4745-ac8d-d18072adc3ba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.235789 May 16 15:21:53.734276 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 49/97] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:53 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:53.756936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:53.757581 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:53.767929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.767929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.767929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:53.768408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:53.910541 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:53.920999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:53.922884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:53.924124 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8a876f2f-f75d-4c75-a32a-8dca3274ccb0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.174982 May 16 15:21:53.924810 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 50/98] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:53 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:21:53.949657 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:53.962037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-66cb0379-2bfa-4515-b282-d2bb218f5a91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.271183 May 16 15:21:53.969158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 49/99] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:53 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:54.385621 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:54.386277 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:54.393097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:54.393619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:54.394420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:54.394859 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:54.601482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:54.610529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-445dbc61-16a4-4ee9-9bb0-d346fa6e0af0 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1315 microversion: 2.1 time: 0.228573 May 16 15:21:54.611440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 51/100] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:54 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:54.744121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:54.744979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:54.752254 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:54.756226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:54.756226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:54.756226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:54.865768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-0aa9dc6a-2820-4044-adc2-27b3a300cd61 req-2b851ac2-13be-438d-9df7-1cf715f0377d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031f5d91-18aa-47bd-a848-e09d19e8f6c4", "tag": "a3126c76-9ed9-4501-8584-9b5b2ba2d62e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:21:54.874333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0aa9dc6a-2820-4044-adc2-27b3a300cd61 req-2b851ac2-13be-438d-9df7-1cf715f0377d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:54.874909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0aa9dc6a-2820-4044-adc2-27b3a300cd61 req-2b851ac2-13be-438d-9df7-1cf715f0377d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:54.888109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-0aa9dc6a-2820-4044-adc2-27b3a300cd61 req-2b851ac2-13be-438d-9df7-1cf715f0377d service nova] Creating event network-changed:a3126c76-9ed9-4501-8584-9b5b2ba2d62e for instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 on hv-cinder-79053 May 16 15:21:54.894015 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-0aa9dc6a-2820-4044-adc2-27b3a300cd61 req-2b851ac2-13be-438d-9df7-1cf715f0377d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035458 May 16 15:21:54.895286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 52/101] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:21:54.945740 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:54.946854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:54.957124 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:54.957789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:54.964569 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:54.964569 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:54.979446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:54.987039 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-096f20a1-ee66-4d9b-9619-4b39f9d0e5e4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.248155 May 16 15:21:54.987917 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 50/102] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:54 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:54.992545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:54.995061 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:55.005057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.005910 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.007362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.008797 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.321469 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:55.333060 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:55.334822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:55.336055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4ba48675-9f2e-4705-918c-d55f946cee8d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.396916 May 16 15:21:55.336766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 53/103] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:54 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:55.475831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:55.487362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-562086fc-db2b-4ccb-9b90-1f888025eb13 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.496391 May 16 15:21:55.501467 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 51/104] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:54 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:55.629518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:55.631929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:55.645030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.646021 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.647058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:55.648451 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:55.805574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:55.805574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8d3873b5-7773-4ed7-8def-0e4212880914 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1503 microversion: 2.1 time: 0.181061 May 16 15:21:55.806387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 54/105] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:55 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:56.004416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.005032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:56.011513 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.011967 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.013385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.013824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.150241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:56.159948 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a06b4622-89ec-4f1a-becb-b94645aa625a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.159584 May 16 15:21:56.160555 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 52/106] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:55 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:56.353914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.354565 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:56.360721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.361166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.361936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.362454 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.490061 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:56.497950 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:56.499463 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:56.500555 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-93f5ed5c-9c3e-4721-87fa-f042b36515aa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.150597 May 16 15:21:56.501110 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 55/107] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:56 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:56.510493 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:56.511110 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:56.517442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.517897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.518694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:56.519129 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:56.646573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:56.654147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8c434323-4c75-44eb-802e-c2e5f918527a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.147625 May 16 15:21:56.654738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 53/108] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:56 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:57.176748 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:57.177398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:57.183345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:57.183850 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:57.184608 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:57.185038 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:57.313170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:57.320573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7a1e6d02-d8b5-4371-82fe-de27298f50b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.147733 May 16 15:21:57.321140 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 56/109] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:57 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:57.518824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:57.520810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:57.525246 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:57.525693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:57.526480 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:57.526909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:57.656623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:57.664451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:57.667352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:57.669000 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48b09cb1-feff-4ea7-b0c6-2a5bd3a910cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.153588 May 16 15:21:57.669573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 54/110] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:57 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:57.671597 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:57.672202 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:57.678154 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:57.678679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:57.679413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:57.680084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:57.814917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:57.822112 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35aad585-3573-4d56-a285-ca2d18a54023 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.154841 May 16 15:21:57.822700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 57/111] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:57 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:58.338170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:58.338701 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:58.345244 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.345690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:58.346473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.346902 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:58.473704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:58.485038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-34bc1653-1e37-4e8d-b8be-881300a3c33a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.146753 May 16 15:21:58.485645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 55/112] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:58 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:58.686764 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:58.687366 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:58.693342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.693781 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:58.694566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.694997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:58.825512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:58.834275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:58.839684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:58.840198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:58.842190 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-de638777-4b06-4534-b3e5-132bafd5dd1e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.159245 May 16 15:21:58.843328 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:58.850640 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.851268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:58.852200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:58.852799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:58.859530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 58/113] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:58 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:21:58.991155 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:58.999277 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f4af4c50-64e3-4e02-88e2-1c8862f50281 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.163627 May 16 15:21:58.999841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 56/114] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:58 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:21:59.504217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:59.504826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:59.510881 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:59.511361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:59.512128 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:59.512576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:59.639647 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:21:59.646986 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-81be234f-3fbe-4c67-a2a7-cc29959234f5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.146678 May 16 15:21:59.647547 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 59/115] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:21:59 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:21:59.870775 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:21:59.871386 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:21:59.885633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:59.885633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:21:59.885633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:21:59.885633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:00.014164 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:00.015916 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:00.016540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:00.022418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:00.022582 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:00.023191 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:00.024067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:00.024432 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:00.024533 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:00.025930 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1b7c1b9b-1bb5-4b4f-910f-cd23688a95be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.161537 May 16 15:22:00.026594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 57/116] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:21:59 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:00.149140 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:00.157028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-46c6332e-81c5-4706-92c5-75780ac3eaad tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.145509 May 16 15:22:00.157592 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 60/117] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:00 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:00.664055 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:00.664664 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:00.670630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:00.671074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:00.671832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:00.672265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:00.794739 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:00.801880 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-029e7642-dbf2-4777-a586-43f731bd782f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.141625 May 16 15:22:00.802479 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 58/118] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:00 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:01.044443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:01.045054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:01.053955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:01.053955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:01.053955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:01.062533 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:01.174086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:01.174856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:01.180596 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:01.181040 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:01.181791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:01.182315 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:01.189406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:01.197347 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:01.198886 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:01.200340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7200863e-b239-4f4b-9264-e58d973ccbbc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.159957 May 16 15:22:01.200641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 61/119] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:01 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:01.311973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:01.319188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a5cc0e42-0eee-48a3-8a96-8856dff19797 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.148880 May 16 15:22:01.319755 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 59/120] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:01 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:01.818970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:01.819580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:01.825571 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:01.826018 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:01.826808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:01.827245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:01.950741 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:01.957972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7993ef1d-18c5-4327-a574-e8c18b2794b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.142799 May 16 15:22:01.958554 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 62/121] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:01 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:02.231051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-3be2c279-961a-4b49-91c1-317fea101e0e req-fb9aa412-ddda-4d11-a165-a606367dfbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a560909-2499-4a61-8c4e-90438829ff82", "name": "network-vif-plugged", "status": "completed", "tag": "800fd8b6-f49e-4bc2-839c-1036a8769d6e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:02.233913 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:02.235338 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:02.240689 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:02.241123 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:02.241953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:02.242435 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:02.244761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3be2c279-961a-4b49-91c1-317fea101e0e req-fb9aa412-ddda-4d11-a165-a606367dfbe0 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:02.245206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3be2c279-961a-4b49-91c1-317fea101e0e req-fb9aa412-ddda-4d11-a165-a606367dfbe0 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:02.256912 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-3be2c279-961a-4b49-91c1-317fea101e0e req-fb9aa412-ddda-4d11-a165-a606367dfbe0 service nova] Creating event network-vif-plugged:800fd8b6-f49e-4bc2-839c-1036a8769d6e for instance 5a560909-2499-4a61-8c4e-90438829ff82 on hv-cinder-79053 May 16 15:22:02.262349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-3be2c279-961a-4b49-91c1-317fea101e0e req-fb9aa412-ddda-4d11-a165-a606367dfbe0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034945 May 16 15:22:02.262973 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 63/122] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:02.337726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:02.338831 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:02.345221 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:02.345754 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:02.346623 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:02.347116 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:02.369239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:02.377978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:02.379553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:02.384425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-57a9e447-efaf-4d27-9459-9e93952ba19b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.156977 May 16 15:22:02.384425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 60/123] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:02 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:02.485968 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:02.493412 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35184bff-7ddc-4436-8470-ef80110bb77d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.160267 May 16 15:22:02.493994 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 64/124] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:02 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:02.973730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:02.974423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:02.980919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:02.981373 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:02.982182 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:02.983220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.245677 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f29cc722-73fb-443e-96b7-f31c437d0e70 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db9beb7e-dc3f-44b2-b12d-e081ad48ff57"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:03.247450 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f29cc722-73fb-443e-96b7-f31c437d0e70 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:03.266913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f29cc722-73fb-443e-96b7-f31c437d0e70 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.266913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f29cc722-73fb-443e-96b7-f31c437d0e70 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.266913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f29cc722-73fb-443e-96b7-f31c437d0e70 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.266913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f29cc722-73fb-443e-96b7-f31c437d0e70 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.581327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:03.599629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-15d27a2b-2553-40c6-8e00-72c004cdcab9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.626069 May 16 15:22:03.601827 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 61/125] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:02 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:03.617105 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:03.617788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:03.624428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.625009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.625828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.626299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.883331 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:03.891991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:03.893564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:03.894707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d40ed0ab-06ce-4b59-bf06-bbab8e4c06fd tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.281455 May 16 15:22:03.895271 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 62/126] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:03 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:03.899594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:03.900268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:03.906092 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.906568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:03.907332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:03.907767 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:04.098399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:04.110568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1a047677-2310-4341-abb9-5e745892289d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.214215 May 16 15:22:04.112199 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 63/127] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:03 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:04.259545 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f29cc722-73fb-443e-96b7-f31c437d0e70 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "POST /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.017677 May 16 15:22:04.260197 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 65/128] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:22:03 2022] POST /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:04.617735 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:04.618387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:04.624660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:04.625113 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:04.625897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:04.626362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:04.756546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:04.765157 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e5ab0656-f00f-44fa-9a56-7998c47603d7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.151161 May 16 15:22:04.765744 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 64/129] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:04 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:04.916519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:04.916519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:04.921634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:04.922068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:04.922858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:04.923291 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:05.129087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:05.129707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:05.136520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:05.136974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:05.138653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:05.139089 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:05.195471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:05.204264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:05.205830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:05.206983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9fd5ee59-a77d-4b74-850a-a039f708966f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.297870 May 16 15:22:05.207590 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 66/130] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:04 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:05.270514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:05.277770 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fdb77158-8e06-4ebc-ae4b-308c4307c88b tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.152577 May 16 15:22:05.278497 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 65/131] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:05 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:05.782303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:05.782928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:05.789022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:05.789534 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:05.790117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:05.790567 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:05.912626 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:05.920658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-36141ff6-0bee-42a0-8d1d-8494349e7425 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.142759 May 16 15:22:05.921217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 67/132] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:05 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:06.224680 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:06.225287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:06.231159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.231608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.232368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.232796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.297707 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:06.300518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:06.304290 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.304744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.305514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.305944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.369740 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:06.378500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:06.380217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:06.381321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b68eefd7-a2fa-4e43-9145-da9fb0e2e1b3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.160569 May 16 15:22:06.381886 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 66/133] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:06 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:06.437072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:06.444397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ad6820d5-0c7b-4f15-a140-76cfa18b7287 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.152559 May 16 15:22:06.444967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 68/134] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:06 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:06.970758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:06.970758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:06.970758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.970758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:06.971105 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:06.971105 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.076009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:07.086363 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0ede7ebc-93cb-4e3d-bff0-78e042f91255 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.150607 May 16 15:22:07.086363 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 67/135] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:06 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:07.399666 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:07.400265 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:07.407161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.426737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.426737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.426737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.461042 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:07.461774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:07.468841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.469407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.470300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:07.470876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:07.542116 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:07.550217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:07.551741 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:07.552848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-13db81e9-d37f-4c69-ae15-465f6c91e04a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.157010 May 16 15:22:07.553408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 69/136] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:07 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:07.603597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:07.610999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-27a06805-ce64-4b1b-9fb8-c7edc07a045d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.154093 May 16 15:22:07.611568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 68/137] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:07 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:08.100743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:08.101422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:08.108403 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.108852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.109787 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.110231 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.249634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:08.273662 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c2ab3b40-a55c-4f88-9642-2bc6d544f8e3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.176615 May 16 15:22:08.274290 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 70/138] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:08 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:08.570477 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:08.571271 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:08.580836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.580836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.580836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.580836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.628679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:08.629293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:08.636108 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.636563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.637353 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:08.637840 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:08.716017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:08.724266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:08.726578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:08.727208 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-665eba30-22fa-40f4-889a-bd88f7b8aaf6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.160899 May 16 15:22:08.727801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 69/139] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:08 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:08.771811 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:08.779209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8c596f6-2871-4375-aa03-a9b6d3eb8b89 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.154463 May 16 15:22:08.780232 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 71/140] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:08 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:09.291332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:09.291943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:09.298560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.299004 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.299758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.300198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.425169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:09.432463 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ac47c536-85bb-4310-8dfa-3de16c37a951 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.144956 May 16 15:22:09.433060 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 70/141] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:09 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:09.744765 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:09.745346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:09.751957 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.752407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.753170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.753607 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.795805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:09.797036 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:09.802917 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.803360 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.804114 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:09.804544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:09.883267 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:09.892402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:09.893894 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:09.895019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ec8d4b17-895e-4e33-8355-ec94da86941e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.154279 May 16 15:22:09.895574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 72/142] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:09 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:09.935876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:09.944901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-34b78eeb-1954-4f9e-9047-5c85489eff03 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.152874 May 16 15:22:09.955292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 71/143] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:09 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:10.448977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:10.449590 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:10.455526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.455976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:10.456740 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.457174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:10.587605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:10.596806 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-995eb39c-82cc-48e6-89d9-2cf2e9d8928b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.151686 May 16 15:22:10.602436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 73/144] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:10 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:10.913466 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:10.914077 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:10.920728 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.923537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:10.923537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.923537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:10.962515 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:10.963433 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:10.984161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.985101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:10.986387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:10.987407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:11.084963 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:11.093903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:11.095570 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:11.096754 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a1eaf9dc-0e3c-4f5a-ad73-7bcd9aba6a22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.187684 May 16 15:22:11.097388 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 72/145] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:10 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:11.186690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:11.194457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d9d43c35-e59a-42f5-ba28-76ea35f9912d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.235774 May 16 15:22:11.195466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 74/146] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:10 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:11.438099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-738194c5-94ca-4177-b12e-77f1b5555173 req-81bd9d49-491e-4149-82a5-48e9bc50e7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca077d05-e39f-4ce2-ba17-bc13b0d34bb4", "name": "network-vif-plugged", "status": "completed", "tag": "28c42936-ecff-4e27-887a-edf723a14aa4"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:11.445966 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-738194c5-94ca-4177-b12e-77f1b5555173 req-81bd9d49-491e-4149-82a5-48e9bc50e7c3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:11.449514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-738194c5-94ca-4177-b12e-77f1b5555173 req-81bd9d49-491e-4149-82a5-48e9bc50e7c3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:11.457663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-738194c5-94ca-4177-b12e-77f1b5555173 req-81bd9d49-491e-4149-82a5-48e9bc50e7c3 service nova] Creating event network-vif-plugged:28c42936-ecff-4e27-887a-edf723a14aa4 for instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 on hv-cinder-79053 May 16 15:22:11.462492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-738194c5-94ca-4177-b12e-77f1b5555173 req-81bd9d49-491e-4149-82a5-48e9bc50e7c3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028002 May 16 15:22:11.463076 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 73/147] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:11.618025 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:11.619062 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:11.629771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:11.630242 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:11.635409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:11.636149 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:11.798330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:11.806102 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fc00a587-fc7c-4f54-a10a-8ab4ade75df0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.193842 May 16 15:22:11.806702 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 75/148] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:11 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:12.119358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:12.120053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:12.128665 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.129428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:12.132869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.132869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:12.211444 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:12.212149 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:12.219408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.219408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:12.219929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.220375 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:12.277572 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:12.286180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:12.295831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:12.297138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b7483438-ac7d-4c48-9991-25c07356c0b8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.185432 May 16 15:22:12.297844 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 74/149] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:12 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:12.382420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:12.389259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-77da7c97-c2f7-4514-a3f0-eba67b6c7a26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.181626 May 16 15:22:12.389853 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 76/150] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:12 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:12.822631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:12.823361 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:12.830118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.831043 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:12.831927 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:12.832546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.006395 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:13.014003 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6ade0a47-3522-4ccc-9761-8ed875945d87 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.195154 May 16 15:22:13.014601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 75/151] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:12 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:13.317766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:13.318688 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:13.325165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:13.326340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.327177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:13.327688 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.409063 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:13.411183 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:13.422372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:13.422819 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.423586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:13.424174 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.572561 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:13.577740 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:13.580681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:13.582940 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:13.584206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a0ac62ee-d3c9-4100-8214-a76930e80725 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.271013 May 16 15:22:13.584919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 77/152] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:13 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:22:13.589822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-46b99e5f-56e9-4542-a762-df37f6b5d1b3 req-f024fdb1-da72-44a8-b708-896ed3558e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea", "name": "network-vif-plugged", "status": "completed", "tag": "24dcea07-8fae-4145-a733-6a29da9a079a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:13.598833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-02ffdedb-8c6c-4267-8c27-b528f91f12c4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.196118 May 16 15:22:13.599424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 76/153] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:13 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:13.605031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-46b99e5f-56e9-4542-a762-df37f6b5d1b3 req-f024fdb1-da72-44a8-b708-896ed3558e34 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:13.605473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-46b99e5f-56e9-4542-a762-df37f6b5d1b3 req-f024fdb1-da72-44a8-b708-896ed3558e34 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:13.617122 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-46b99e5f-56e9-4542-a762-df37f6b5d1b3 req-f024fdb1-da72-44a8-b708-896ed3558e34 service nova] Creating event network-vif-plugged:24dcea07-8fae-4145-a733-6a29da9a079a for instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea on hv-cinder-79053 May 16 15:22:13.622959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-46b99e5f-56e9-4542-a762-df37f6b5d1b3 req-f024fdb1-da72-44a8-b708-896ed3558e34 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036604 May 16 15:22:13.623559 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 78/154] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:14.030642 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:14.031327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:14.037590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.038039 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.038816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.039241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.172730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:14.180065 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-439342f7-8b4c-4fbf-b491-19e47d65c10f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.153534 May 16 15:22:14.190160 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 77/155] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:14 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:14.602693 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:14.603416 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:14.615923 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.616640 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.617429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.617670 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:14.618225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.618479 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:14.625995 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.627070 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.628019 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:14.628598 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:14.787291 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:14.800195 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-06c07064-5de3-4de4-add4-512c6df3a856 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.188194 May 16 15:22:14.800293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:14.800955 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 78/156] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:14 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:14.808382 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:14.809928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:14.811074 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d5550112-5b20-4528-8793-6969abd01843 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.212692 May 16 15:22:14.811629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 79/157] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:14 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:15.196797 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:15.197519 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:15.204056 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.204763 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.205647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.206213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.344534 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:15.359669 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-afa772ae-6573-4bce-9442-44e991aff2c7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.166735 May 16 15:22:15.360300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 79/158] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:15 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:15.817517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:15.818333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:15.826218 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.826945 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.828006 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.828760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.832131 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:15.832785 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:15.841651 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.842099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:15.843784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:15.844410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.011569 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:16.019603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f6f57cc5-a681-4c55-9c78-18bb044b6317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.206084 May 16 15:22:16.020179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 80/159] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:15 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:16.063057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:16.080713 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:16.082598 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:16.083722 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e2777a56-78ae-4cab-b6b1-c3070069b686 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.257495 May 16 15:22:16.085106 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 80/160] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:15 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:16.375873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:16.378225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:16.385240 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.385975 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.387003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:16.387668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:16.561945 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:16.569485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-78a1e854-6df3-4e71-b032-acce29d9c8ab tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.197658 May 16 15:22:16.570067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 81/161] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:16 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:17.038220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:17.039450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:17.047943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.050947 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.050947 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.050947 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.109422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:17.110339 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:17.117151 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.117877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.118857 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.119459 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.236172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:17.245924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c3ee82eb-1120-4faa-a506-1b36b12601d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1361 microversion: 2.1 time: 0.212934 May 16 15:22:17.247150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 81/162] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:17 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:17.288291 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:17.297290 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:17.298841 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:17.300039 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-64182716-2ade-494e-9098-e16dff70bc7b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.197791 May 16 15:22:17.300577 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 82/163] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:17 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:22:17.585708 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:17.586356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:17.594910 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.595626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.596612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:17.598016 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:17.745645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:17.753811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-886aff29-5eb5-44ed-9912-98bf58e77a72 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.171772 May 16 15:22:17.754265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 82/164] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:17 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:18.266879 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:18.278887 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:18.289481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.289481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.289481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.289481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.318239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:18.319422 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:18.331339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.334104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.334104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.334104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.516458 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:18.520400 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:18.522342 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:18.523840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-54894096-5c54-4a1c-a772-a55a92f3a89d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.209338 May 16 15:22:18.524564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 83/165] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:18 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:18.536456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:18.545191 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7a5dc848-7767-4943-b498-20db0f820d68 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1547 microversion: 2.1 time: 0.282058 May 16 15:22:18.545975 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 83/166] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:18 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1547 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:18.562573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b9627859-f9ed-4514-942f-5f35ae23fe74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:18.563382 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b9627859-f9ed-4514-942f-5f35ae23fe74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:18.569629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9627859-f9ed-4514-942f-5f35ae23fe74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.570405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9627859-f9ed-4514-942f-5f35ae23fe74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.571410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9627859-f9ed-4514-942f-5f35ae23fe74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.572031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9627859-f9ed-4514-942f-5f35ae23fe74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.629455 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-a1d0853c-7017-4ee7-984e-bac747fb1c03 req-2ff38282-a8e6-445b-ab73-83a393f450b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f5d91-18aa-47bd-a848-e09d19e8f6c4", "name": "network-vif-plugged", "status": "completed", "tag": "a3126c76-9ed9-4501-8584-9b5b2ba2d62e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:18.649934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a1d0853c-7017-4ee7-984e-bac747fb1c03 req-2ff38282-a8e6-445b-ab73-83a393f450b3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.650414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a1d0853c-7017-4ee7-984e-bac747fb1c03 req-2ff38282-a8e6-445b-ab73-83a393f450b3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.661782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-a1d0853c-7017-4ee7-984e-bac747fb1c03 req-2ff38282-a8e6-445b-ab73-83a393f450b3 service nova] Creating event network-vif-plugged:a3126c76-9ed9-4501-8584-9b5b2ba2d62e for instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 on hv-cinder-79053 May 16 15:22:18.673388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-a1d0853c-7017-4ee7-984e-bac747fb1c03 req-2ff38282-a8e6-445b-ab73-83a393f450b3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047807 May 16 15:22:18.675252 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 84/167] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:18.698442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b9627859-f9ed-4514-942f-5f35ae23fe74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139957 May 16 15:22:18.699049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 84/168] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:22:18 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:18.770673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:18.771375 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:18.777837 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.778352 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.779486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:18.779926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:18.917774 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:18.926469 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5454dfbf-eb6b-4a5e-9682-647c7021e026 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1322 microversion: 2.1 time: 0.160400 May 16 15:22:18.927051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 85/169] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:18 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:19.542292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:19.542894 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:19.548817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.549249 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.550005 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.550454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.726662 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.734492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.736002 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:19.737099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9ebfe1dc-d98e-47d0-b82f-16a35993e49b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.198911 May 16 15:22:19.737745 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 85/170] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:19 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:19.944360 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:19.945141 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:19.952256 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.952712 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:19.953486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:19.953920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.095085 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.102541 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cfaa44da-d0fd-42b3-b051-bdbfa0c57156 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1516 microversion: 2.1 time: 0.162211 May 16 15:22:20.103270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 86/171] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:19 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:20.125592 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:20.126737 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.132731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.133177 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.134344 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.134940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.161832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lazy-loading 'flavor' on Instance uuid ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:20.212523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-a03df7c0-1b46-437a-aad6-973b5bd805f5 req-5bad71db-ccb8-4226-b9a1-45a001bd729b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca077d05-e39f-4ce2-ba17-bc13b0d34bb4", "tag": "28c42936-ecff-4e27-887a-edf723a14aa4"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:20.224502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a03df7c0-1b46-437a-aad6-973b5bd805f5 req-5bad71db-ccb8-4226-b9a1-45a001bd729b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.225084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a03df7c0-1b46-437a-aad6-973b5bd805f5 req-5bad71db-ccb8-4226-b9a1-45a001bd729b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.238101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-a03df7c0-1b46-437a-aad6-973b5bd805f5 req-5bad71db-ccb8-4226-b9a1-45a001bd729b service nova] Creating event network-changed:28c42936-ecff-4e27-887a-edf723a14aa4 for instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 on hv-cinder-79053 May 16 15:22:20.248111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-a03df7c0-1b46-437a-aad6-973b5bd805f5 req-5bad71db-ccb8-4226-b9a1-45a001bd729b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034582 May 16 15:22:20.248111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 87/172] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:22:20.557774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cd361193-9665-42c8-9d87-0d9b5fee00c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea/action" status: 200 len: 32 microversion: 2.1 time: 0.436864 May 16 15:22:20.558672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 86/173] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:22:20 2022] POST /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea/action => generated 32 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:22:20.569204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.569895 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.577288 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.577899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.578687 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.579119 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.714979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.723161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d5c1727a-c260-4496-9e99-27613e72997e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.158464 May 16 15:22:20.723768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 88/174] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:20.760975 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:20.761672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:20.767980 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.768429 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.769573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:20.770007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:20.900809 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.909091 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.910616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:20.911725 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-25228c72-d573-42e5-abbe-64cf49abf5cf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.155408 May 16 15:22:20.912289 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 87/175] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:20 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:21.740658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:21.741298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:21.747948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.748392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.749149 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.749587 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.880733 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:21.888499 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b4d1fa50-692e-414d-a75f-72668685df5b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.151685 May 16 15:22:21.889052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 89/176] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:21 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:21.929914 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:21.930553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:21.936546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.936991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:21.937761 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:21.938216 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.068614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:22.077148 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:22.078872 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:22.080061 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5579e876-ad28-4612-88eb-51182cdf6d56 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.153987 May 16 15:22:22.080627 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 88/177] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:21 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:22.908652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:22.909258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:22.915663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.916106 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:22.916893 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:22.917325 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.052780 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.060286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e224ba75-9543-4793-9c9b-95544c8491e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.156916 May 16 15:22:23.060861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 90/178] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:22 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:23.097749 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:23.098395 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:23.104317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.104764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.110031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:23.110031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:23.248096 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.257760 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.259858 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:23.261045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ef3a04b0-6ddb-402a-a897-fbea56846b2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.167168 May 16 15:22:23.261595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 89/179] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:23 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:24.077096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:24.077602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:24.083902 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.084341 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.085094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.085528 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.215955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.223510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b037f404-2c80-4958-8ffb-09f438b8bb71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.150389 May 16 15:22:24.224077 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 91/180] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:24 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:24.282770 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:24.283377 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:24.289352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.289856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.291007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:24.291535 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:24.427975 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.437071 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.438588 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:24.439677 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3f9adb3e-b209-44ac-8932-ebee0f1f710e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.160908 May 16 15:22:24.440233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 90/181] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:24 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:25.241605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:25.242657 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:25.249452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.249900 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.250707 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.251144 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.384880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:25.392668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3eff5525-3f60-4de1-982b-b9e1ebf37b38 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.155922 May 16 15:22:25.393233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 92/182] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:25 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:25.458276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:25.458811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:25.464703 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.465151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.465916 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:25.466371 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:25.607380 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:25.615658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:25.617350 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:25.618690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-71e1dee9-d124-4cfc-8beb-7a8871bd1d34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.164415 May 16 15:22:25.619818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 91/183] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:25 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:26.410027 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:26.410714 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:26.418450 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.419287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.420064 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.420491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.638592 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:26.639205 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:26.657542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.658397 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.659120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.659556 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.779803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.792156 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7aefbcde-8d30-4624-9ec8-17178e8134b1 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.384843 May 16 15:22:26.798318 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 93/184] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:26 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:26.814718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:26.815392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:26.822539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.823166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.824243 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:26.824859 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:26.852784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:22:26.875741 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.883998 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.885543 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:26.886707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0c8a5825-082c-4c81-bc37-ab7144cbd89f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.252712 May 16 15:22:26.887301 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 92/185] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:26 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:27.494585 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2a1d3588-479a-4ca3-9f89-12d259f457ce tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "DELETE /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 204 len: 0 microversion: 2.1 time: 0.683462 May 16 15:22:27.495339 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 94/186] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:22:26 2022] DELETE /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:22:27.504082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.504965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.511092 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.511676 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.512303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.512739 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.677066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:27.687801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d4c1c603-df75-4d7d-bad3-8b24b4a3941f tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1555 microversion: 2.1 time: 0.187627 May 16 15:22:27.690025 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 93/187] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:27 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:27.812820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.813574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.822968 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.823428 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.824241 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.824677 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.907171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:27.908093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:27.918742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.923447 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:27.925969 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:27.929049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.010478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:28.018658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3a3b1ed7-4c3f-4575-b94a-86c86a4c3a13 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.210797 May 16 15:22:28.019259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 95/188] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:27 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:28.154935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:28.169471 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:28.172610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:28.176988 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d077ed49-3c41-42f2-a38c-2bab9fff0e4b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1408 microversion: 2.20 time: 0.273344 May 16 15:22:28.176988 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 94/189] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:27 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:28.704961 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:28.705575 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:28.722192 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.722192 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.722192 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:28.722192 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:28.889563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:28.897707 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-75dd89a0-19f3-4863-84ca-af304a9dc8de tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1555 microversion: 2.1 time: 0.196617 May 16 15:22:28.898613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 96/190] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:28 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:29.035278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:29.035911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:29.041886 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.042368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.043128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.044120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.180517 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.190047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d0080f6a-d4e6-4c0c-87b7-cdcdcba4bfe7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.158498 May 16 15:22:29.190751 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 95/191] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:29 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:29.193085 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:29.193722 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:29.201667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.202539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.203690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.204340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.358691 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.366957 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.370308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:29.370308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7a76135f-8731-48bf-87e1-73576322bce4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1600 microversion: 2.20 time: 0.180776 May 16 15:22:29.370308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 97/192] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:22:29 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:22:29.391369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2af9fdad-d6d2-4522-88e6-603401dff28a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:29.391891 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2af9fdad-d6d2-4522-88e6-603401dff28a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:29.400584 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2af9fdad-d6d2-4522-88e6-603401dff28a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.401442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2af9fdad-d6d2-4522-88e6-603401dff28a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.402963 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2af9fdad-d6d2-4522-88e6-603401dff28a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.403452 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2af9fdad-d6d2-4522-88e6-603401dff28a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.490534 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2af9fdad-d6d2-4522-88e6-603401dff28a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103655 May 16 15:22:29.491077 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 96/193] 10.222.0.76 () {60 vars in 1315 bytes} [Mon May 16 15:22:29 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:22:29.915805 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:29.916416 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:29.925109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.927098 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:29.938772 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:29.939666 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.108109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:30.118296 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-27c45bbc-df8b-46ed-9a0a-e64f1b2330d2 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1555 microversion: 2.1 time: 0.206135 May 16 15:22:30.118926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 98/194] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:29 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1555 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:30.207769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:30.208463 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:30.215184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.217083 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.218294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:30.219080 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:30.638317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:30.648646 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-271f11f6-8d29-4590-9dca-55535722752b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.444143 May 16 15:22:30.659519 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 97/195] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:30 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:31.120068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-0070b2b1-2c7e-4dd6-b89e-a6ed7d8483dd req-f8b003fb-2c26-45b0-8097-fc93d5dd6761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031f5d91-18aa-47bd-a848-e09d19e8f6c4", "tag": "a3126c76-9ed9-4501-8584-9b5b2ba2d62e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:31.131188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0070b2b1-2c7e-4dd6-b89e-a6ed7d8483dd req-f8b003fb-2c26-45b0-8097-fc93d5dd6761 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.133641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-0070b2b1-2c7e-4dd6-b89e-a6ed7d8483dd req-f8b003fb-2c26-45b0-8097-fc93d5dd6761 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.137818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:31.139933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:31.146517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-0070b2b1-2c7e-4dd6-b89e-a6ed7d8483dd req-f8b003fb-2c26-45b0-8097-fc93d5dd6761 service nova] Creating event network-changed:a3126c76-9ed9-4501-8584-9b5b2ba2d62e for instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 on hv-cinder-79053 May 16 15:22:31.148146 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.148811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.150950 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.151865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.152196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-0070b2b1-2c7e-4dd6-b89e-a6ed7d8483dd req-f8b003fb-2c26-45b0-8097-fc93d5dd6761 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035597 May 16 15:22:31.153650 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 99/196] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:31.668462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:31.670223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:31.681550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.682280 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.683230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:31.683794 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:31.749223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:31.760983 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db6034be-8d7a-4072-af76-bc0e3e39303e tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1555 microversion: 2.1 time: 0.628234 May 16 15:22:31.772932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 98/197] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:31 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1555 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:31.943653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:31.961384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1eb3214d-fe2f-477e-a6ef-343171a12957 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.296926 May 16 15:22:31.962712 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 100/198] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:31 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:32.779797 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:32.781817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:32.794612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.795049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:32.795820 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.796256 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:32.833716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.834464 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:32.834965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lazy-loading 'fault' on Instance uuid 426beb7e-b95a-4ede-a2e0-d28d28123018 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:22:32.884899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da6d35c6c78443ba0319643a5e219d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3733b202412047fa87928b2a71871f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:32.893979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c8d673ca-039a-4ed3-ae60-3cb48dc20abf tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 200 len: 1351 microversion: 2.1 time: 0.119392 May 16 15:22:32.903602 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 99/199] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:32 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:32.979114 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:32.979725 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:32.986242 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.986686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:32.987627 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:32.988055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:33.128469 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:33.146824 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-df9b2f13-4d15-4daa-8f90-cc573c864eba tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.171551 May 16 15:22:33.147401 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 101/200] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:32 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:33.168151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2abe9a36-6828-44e3-9b76-4593d6686233 req-096ae9d3-3498-428d-9a38-69de1ed4459d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "426beb7e-b95a-4ede-a2e0-d28d28123018", "name": "network-vif-deleted", "tag": "b89d0803-a75d-4e81-8ba8-81628dc521e2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:22:33.176585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2abe9a36-6828-44e3-9b76-4593d6686233 req-096ae9d3-3498-428d-9a38-69de1ed4459d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:33.177034 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2abe9a36-6828-44e3-9b76-4593d6686233 req-096ae9d3-3498-428d-9a38-69de1ed4459d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:33.189450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2abe9a36-6828-44e3-9b76-4593d6686233 req-096ae9d3-3498-428d-9a38-69de1ed4459d service nova] Creating event network-vif-deleted:b89d0803-a75d-4e81-8ba8-81628dc521e2 for instance 426beb7e-b95a-4ede-a2e0-d28d28123018 on hv-cinder-79053 May 16 15:22:33.194266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2abe9a36-6828-44e3-9b76-4593d6686233 req-096ae9d3-3498-428d-9a38-69de1ed4459d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029780 May 16 15:22:33.195169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 100/201] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:22:33.913047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:33.913666 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:33.920411 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:33.920864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:33.921640 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:33.922077 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:33.937200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] HTTP exception thrown: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Request method failure captured: May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 HTTP/1.1 May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmvl7H60mapgdoek41Phojdla92ncMMQxI9mvKH2plJZr-VNLaIufmiSPvU1AGkLz7W7YapBKJJ3O16-BeS4mOFojEcfbznkUSxdWrgOoi-114SOMfayI7hoO5Va97qDCzYpMbl7YlKTGKBo5DE09aHOG6gMRdYH1KiDZCAEYlryA0Q May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:22:33.942408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3733b202412047fa87928b2a71871f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3733b202412047fa87928b2a71871f5e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-DeleteServersTestJSON-216178858 May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6da6d35c6c78443ba0319643a5e219d9 May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:33.943669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '426beb7e-b95a-4ede-a2e0-d28d28123018'} May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:33.944343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:33.945471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:33.946726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Returning 404 to user: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:33.946726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5bcb1bb4-0e06-4049-ac83-bfd2200db234 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 404 len: 111 microversion: 2.1 time: 0.034847 May 16 15:22:33.946726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 102/202] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:33 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:34.048420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:34.049431 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:34.055858 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:34.056299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.057746 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:34.057746 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.070780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] HTTP exception thrown: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Request method failure captured: May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018/os-volume_attachments HTTP/1.1 May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmvl7H60mapgdoek41Phojdla92ncMMQxI9mvKH2plJZr-VNLaIufmiSPvU1AGkLz7W7YapBKJJ3O16-BeS4mOFojEcfbznkUSxdWrgOoi-114SOMfayI7hoO5Va97qDCzYpMbl7YlKTGKBo5DE09aHOG6gMRdYH1KiDZCAEYlryA0Q May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:22:34.076541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3733b202412047fa87928b2a71871f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3733b202412047fa87928b2a71871f5e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-DeleteServersTestJSON-216178858 May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 6da6d35c6c78443ba0319643a5e219d9 May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:34.077783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '426beb7e-b95a-4ede-a2e0-d28d28123018'} May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:34.078454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:34.079503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:34.080553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Returning 404 to user: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:34.080553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-26bf1131-0d5e-4a08-a9f5-699d76b3f86b tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034039 May 16 15:22:34.080553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 101/203] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:22:34 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:34.163830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:34.164446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:34.170394 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:34.170849 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.171619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:34.172056 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:34.310431 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:34.317723 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3a2a016c-714c-401e-81dc-6624d7d00f1a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.157857 May 16 15:22:34.318333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 103/204] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:34 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:35.335159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:35.335765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:35.343454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:35.343903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:35.344661 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:35.345094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:35.484786 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:35.492208 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-20db2b99-4a7f-4fba-a049-f9fb06cf348d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.161010 May 16 15:22:35.492768 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 102/205] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:35 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:36.107427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:36.108733 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:36.115860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.116511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.117440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.119420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.136211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] HTTP exception thrown: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Request method failure captured: May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 HTTP/1.1 May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmvl7H60mapgdoek41Phojdla92ncMMQxI9mvKH2plJZr-VNLaIufmiSPvU1AGkLz7W7YapBKJJ3O16-BeS4mOFojEcfbznkUSxdWrgOoi-114SOMfayI7hoO5Va97qDCzYpMbl7YlKTGKBo5DE09aHOG6gMRdYH1KiDZCAEYlryA0Q May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:22:36.138568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3733b202412047fa87928b2a71871f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3733b202412047fa87928b2a71871f5e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-DeleteServersTestJSON-216178858 May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6da6d35c6c78443ba0319643a5e219d9 May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.139830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '426beb7e-b95a-4ede-a2e0-d28d28123018'} May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:36.140735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.142000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:22:36.143158 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Returning 404 to user: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:36.143158 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cf86b0d5-959f-4479-92e3-c88dde410df9 tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "DELETE /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 404 len: 111 microversion: 2.1 time: 0.037136 May 16 15:22:36.143158 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 104/206] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:22:36 2022] DELETE /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:36.148837 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:36.149447 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] [instance: 426beb7e-b95a-4ede-a2e0-d28d28123018] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:36.156200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.156640 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.157673 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.158102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.171383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] HTTP exception thrown: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Request method failure captured: May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 HTTP/1.1 May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmvl7H60mapgdoek41Phojdla92ncMMQxI9mvKH2plJZr-VNLaIufmiSPvU1AGkLz7W7YapBKJJ3O16-BeS4mOFojEcfbznkUSxdWrgOoi-114SOMfayI7hoO5Va97qDCzYpMbl7YlKTGKBo5DE09aHOG6gMRdYH1KiDZCAEYlryA0Q May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:22:36.173487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/3733b202412047fa87928b2a71871f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_3733b202412047fa87928b2a71871f5e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/3733b202412047fa87928b2a71871f5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-DeleteServersTestJSON-216178858 May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 3733b202412047fa87928b2a71871f5e May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-DeleteServersTestJSON-216178858 May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 6da6d35c6c78443ba0319643a5e219d9 May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-DeleteServersTestJSON-216178858-project May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.174830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '426beb7e-b95a-4ede-a2e0-d28d28123018'} May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:22:36.175492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. May 16 15:22:36.176718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:22:36.177932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] Returning 404 to user: Instance 426beb7e-b95a-4ede-a2e0-d28d28123018 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:22:36.177932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a80b181c-7cd3-4ceb-8227-c34f427fb2ee tempest-DeleteServersTestJSON-216178858 tempest-DeleteServersTestJSON-216178858-project] 10.222.0.76 "GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018" status: 404 len: 111 microversion: 2.1 time: 0.030281 May 16 15:22:36.177932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 103/207] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:36 2022] GET /compute/v2.1/servers/426beb7e-b95a-4ede-a2e0-d28d28123018 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:22:36.509286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:36.510011 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:36.518420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.519187 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.520088 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:36.520893 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:36.741179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:36.758981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b3cf98f9-3624-4076-b133-409380022550 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.254082 May 16 15:22:36.760808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 105/208] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:36 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:37.781454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:37.782065 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:37.788226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:37.788881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:37.789812 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:37.790430 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:37.924606 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:37.932065 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9e4a1d64-ee1b-4192-ac75-bd334691c90c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.155287 May 16 15:22:37.932631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 104/209] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:37 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:38.948758 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:38.949988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:38.956858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:38.957313 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:38.958086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:38.958551 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:39.114619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:39.122248 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5ae7db2e-320e-4554-8911-fcfff6fac88e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.177024 May 16 15:22:39.122822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 106/210] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:38 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:40.138730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:40.144501 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:40.145318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:40.145795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:40.146595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:40.147053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:40.284171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:40.292355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-23e7844e-dcc6-4647-be4c-458e2c281f4e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.157604 May 16 15:22:40.292937 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 105/211] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:40 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:41.308826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:41.309455 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:41.315894 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:41.316339 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:41.317106 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:41.317539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:41.449952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:41.457803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1923cda-4418-4126-86ee-d8807f9ade14 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.153005 May 16 15:22:41.458405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 107/212] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:41 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:42.474939 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:42.475545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:42.482428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:42.482869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:42.483765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:42.484251 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:42.632866 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:42.641209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-557bb80d-1554-4c5a-aae7-44fe621ee239 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.170301 May 16 15:22:42.641785 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 106/213] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:42 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:43.659135 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:43.659905 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:43.666681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:43.669094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:43.669094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:43.669094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:43.819996 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:43.827978 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a8065b2f-2908-4106-a97e-3d18d2e4bb96 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.172933 May 16 15:22:43.828732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 108/214] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:43 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:44.848107 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:44.850230 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:44.855095 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:44.856084 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:44.856851 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:44.857458 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:45.015575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:45.023962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e778f02f-f8e1-44c0-bb31-886e7ef3c311 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.179608 May 16 15:22:45.024601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 107/215] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:44 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:46.040994 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:46.041562 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:46.047857 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:46.048303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:46.049058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:46.049488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:46.174437 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:46.181942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a9d17588-6284-4fa0-8fd3-1c56375876c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.144848 May 16 15:22:46.187873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 109/216] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:46 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:47.202201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:47.202201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:47.210284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:47.210950 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:47.211978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:47.213211 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:47.374191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:47.382108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-adf23ab5-af0d-40d1-ba70-917a6f2e78b7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.186245 May 16 15:22:47.383100 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 108/217] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:47 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:48.399558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:48.400696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:48.408791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:48.408972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:48.409619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:48.410286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:48.568933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:48.577171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1fff5b07-d6db-4f09-902b-d5cbe9453b1c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.181518 May 16 15:22:48.577855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 110/218] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:48 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:49.594942 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:49.595340 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:49.606024 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:49.606895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:49.610401 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:49.610401 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:49.819186 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:49.827045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-62b0642a-da5d-443a-ab7f-650cb7df0bbf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.236642 May 16 15:22:49.827808 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 109/219] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:49 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:50.843893 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:50.844501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:50.852089 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:50.852546 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:50.853352 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:50.853939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:51.016794 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:51.024228 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1c6a013f-0d55-4475-8b12-062148c7968f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.184106 May 16 15:22:51.024833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 111/220] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:50 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:52.040771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:52.041409 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:52.048365 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:52.048818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:52.049583 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:52.050018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:52.205086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:52.213097 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7c153b89-f2c2-4884-9c7e-d4745ba2eed2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.176044 May 16 15:22:52.214060 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 110/221] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:52 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:53.231337 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:53.231846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:53.238156 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:53.238680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:53.239457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:53.239914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:53.415632 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:53.423943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a60d59cb-5076-4e1b-9cc8-b9cf54ca041b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.197083 May 16 15:22:53.424558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 112/222] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:53 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:22:54.441796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:54.497720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:54.497720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:54.497720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:54.497720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:54.498227 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:54.593155 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:54.606356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-16a334fc-feba-4367-9065-86a4b91dc5b0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.168267 May 16 15:22:54.606937 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 111/223] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:54 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:55.624060 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:55.624699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:55.630939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:55.631385 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:55.632156 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:55.632590 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:55.779447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:55.789095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-be044da6-b833-4ce9-8b8e-d82d4586fc98 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.169805 May 16 15:22:55.789917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 113/224] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:55 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:56.806577 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:56.807191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:56.814255 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:56.814884 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:56.821069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:56.821069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:56.965224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:56.971230 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f3e4a8bf-df9e-4489-96e8-b66c32a459d6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.168797 May 16 15:22:56.971803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 112/225] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:56 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:57.988316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:57.994244 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:58.003355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:58.003806 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:58.004609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:58.005112 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:58.147656 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:58.155931 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e3bf92c0-e3d7-4b1b-a9aa-a6320f0ac98f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.171365 May 16 15:22:58.156573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 114/226] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:57 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:22:59.172973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:22:59.173579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:22:59.179346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:59.179793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:59.180535 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:22:59.180958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:22:59.310318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:22:59.317777 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a4e2df46-e651-4356-a559-a6b7d82de698 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.148622 May 16 15:22:59.322278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 113/227] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:22:59 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:00.338369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:00.338369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:00.346510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:00.346968 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:00.347752 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:00.348194 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:00.497427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:00.497427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dc37966c-e8b9-4eed-9d6d-0e07a15b3fac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.155944 May 16 15:23:00.497427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 115/228] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:00 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:01.503779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:01.504394 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:01.510340 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.510793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.511752 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:01.512376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:01.667706 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:01.677968 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-090da644-ed52-41aa-95e6-bb4a128d1e21 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.177991 May 16 15:23:01.678774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 114/229] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:01 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:02.694962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:02.695589 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:02.701935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:02.702418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:02.703184 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:02.703616 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:02.836641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:02.845077 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6bf56421-bd85-4b16-84d6-9ada7c3331d3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.153967 May 16 15:23:02.845660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 116/230] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:02 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:03.862331 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:03.866102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:03.869148 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:03.869596 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:03.870386 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:03.870816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:04.040541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:04.048266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ba82c37d-b332-4d31-a078-2a1e4c140c4f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.189886 May 16 15:23:04.048841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 115/231] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:03 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:05.065402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:05.066196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:05.072139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:05.072644 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:05.073540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:05.074045 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:05.215543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:05.222164 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c04df109-aa20-442d-97c7-343c3952659b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1522 microversion: 2.1 time: 0.160672 May 16 15:23:05.222730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 117/232] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:05 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:06.239244 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:06.239813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:06.245537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.245974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.247537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.247964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.379399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:06.386622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-12ef522f-d4b9-4e24-96ce-29e55ab70eb3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1502 microversion: 2.1 time: 0.151690 May 16 15:23:06.387187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 116/233] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:06 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:06.403439 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:06.404076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:06.410509 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.416407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.416407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:06.416407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:06.543218 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:06.550782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7f9e0615-ef30-4bf4-92af-f28dff17d34e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1514 microversion: 2.1 time: 0.151132 May 16 15:23:06.551360 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 118/234] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:06 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:07.270758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8375173b-0549-43aa-b1b6-500047a7e5f7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:07.271237 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8375173b-0549-43aa-b1b6-500047a7e5f7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:07.277672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8375173b-0549-43aa-b1b6-500047a7e5f7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.278088 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8375173b-0549-43aa-b1b6-500047a7e5f7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.279540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8375173b-0549-43aa-b1b6-500047a7e5f7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:07.279855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8375173b-0549-43aa-b1b6-500047a7e5f7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:07.304248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8375173b-0549-43aa-b1b6-500047a7e5f7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/ips" status: 200 len: 146 microversion: 2.1 time: 0.037361 May 16 15:23:07.304818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 117/235] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:23:07 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:08.827962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:08.828988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:08.835813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:08.836130 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:08.837049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:08.837723 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:08.871849 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lazy-loading 'flavor' on Instance uuid 5a560909-2499-4a61-8c4e-90438829ff82 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:23:09.436324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d14d9516-d03e-41ef-9421-dcb8622b9a51 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82/action" status: 200 len: 32 microversion: 2.1 time: 0.613254 May 16 15:23:09.437311 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 119/236] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:23:08 2022] POST /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82/action => generated 32 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:23:09.452640 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:09.454413 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:09.469470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:09.470778 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:09.471749 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:09.472581 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:09.613147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:09.633267 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9ab914fb-34ea-43a9-87dd-7f013d3d3e45 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.187820 May 16 15:23:09.634880 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 118/237] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:09 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:10.651827 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:10.652544 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:10.660431 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:10.660886 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:10.661728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:10.662200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:10.819558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:10.827553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ef547d36-845c-4961-ac6d-4e51f454a4ef tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.179976 May 16 15:23:10.828125 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 120/238] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:10 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:11.061058 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ddb42499-1598-4340-a71e-9635586cc0ae tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f608ba5-68f0-4d92-9491-504e13612935"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:11.062822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ddb42499-1598-4340-a71e-9635586cc0ae tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:11.069623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb42499-1598-4340-a71e-9635586cc0ae tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:11.073052 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb42499-1598-4340-a71e-9635586cc0ae tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:11.073052 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb42499-1598-4340-a71e-9635586cc0ae tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:11.073052 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ddb42499-1598-4340-a71e-9635586cc0ae tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:11.846078 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:11.847668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:11.860108 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:11.860862 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:11.861737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:11.865220 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:12.005128 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:12.012404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-98d1a153-6def-44ae-86f5-5dbc3d003dd5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.172014 May 16 15:23:12.013845 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 121/239] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:11 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:12.218416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ddb42499-1598-4340-a71e-9635586cc0ae tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.161172 May 16 15:23:12.219023 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 119/240] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:23:11 2022] POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-volume_attachments => generated 194 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:13.030698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:13.031306 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:13.039923 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:13.040377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:13.041160 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:13.041596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:13.200462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:13.208111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-af59be27-6a0b-4f1e-82c1-cda555f436d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.181751 May 16 15:23:13.208675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 122/241] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:13 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:14.225865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:14.226594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:14.233890 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:14.234376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:14.235336 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:14.235935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:14.456780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:14.464404 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4de5f569-bc06-4d91-ac42-4d92b283b14a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.242809 May 16 15:23:14.465079 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 120/242] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:14 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:15.482864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:15.483689 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:15.491196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:15.491847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:15.493141 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:15.493730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:15.628732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:15.636075 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-375f1890-063a-43ee-8cc7-178c2b4f9aea tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.158731 May 16 15:23:15.636636 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 123/243] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:15 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:15.891855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1538841181", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:15.944252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] validate_networks() for None {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:23:16.261266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:23:16.262103 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:23:16.263484 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:23:16.263905 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:23:16.264318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:23:16.274014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:16.276260 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:16.276260 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:16.276260 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:16.292737 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Getting quotas for project fa49f4881c1041528d8071d3cc64a5b0. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:23:16.297621 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Getting quotas for user 5d7434af378b4247aefbe0783cd128c0 and project fa49f4881c1041528d8071d3cc64a5b0. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:23:16.312622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:23:16.314492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:23:16.495094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6d0fbb24-3894-4018-93f1-0d11020e9a61 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609136 May 16 15:23:16.502560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 121/244] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:23:16.507596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-77e5531b-6ed1-46d2-a37c-6fb7b54aa4af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:16.508796 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-77e5531b-6ed1-46d2-a37c-6fb7b54aa4af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:16.619543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-77e5531b-6ed1-46d2-a37c-6fb7b54aa4af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:16.633936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-77e5531b-6ed1-46d2-a37c-6fb7b54aa4af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1215 microversion: 2.1 time: 0.129854 May 16 15:23:16.639646 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 124/245] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:16 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:16.662091 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:16.662948 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:16.671312 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:16.671983 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:16.672969 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:16.673417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:16.881071 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:16.898448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-878d6153-be9f-49e7-976d-88506ddf7bc4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.246753 May 16 15:23:16.900558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 122/246] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:16 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:17.651225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-804f4070-5e45-47f6-a856-6ed6d66f20af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:17.651837 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-804f4070-5e45-47f6-a856-6ed6d66f20af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:17.706584 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-804f4070-5e45-47f6-a856-6ed6d66f20af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:17.713711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-804f4070-5e45-47f6-a856-6ed6d66f20af tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1215 microversion: 2.1 time: 0.066435 May 16 15:23:17.714299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 125/247] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:17 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:17.916802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:17.917532 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:17.931159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:17.931159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:17.931159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:17.931159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:18.099788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:18.109815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bef0b028-67a8-4867-b9b3-58248f0c96b4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.197026 May 16 15:23:18.110473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 123/248] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:17 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:18.732233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:18.732233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:18.742929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:18.743486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:18.744441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:18.745054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:18.849115 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:18.860776 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a60a6f72-8581-40b9-83cc-20224c79e56f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1267 microversion: 2.1 time: 0.133980 May 16 15:23:18.867877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 126/249] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:18 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:19.128014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:19.128625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:19.135049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:19.135498 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:19.136262 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:19.136750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:19.369514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:19.389152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-af623dbe-e927-472c-ad5b-493f984d186f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.257275 May 16 15:23:19.389152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 124/250] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:19 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:19.882649 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:19.883241 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:19.889271 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:19.889728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:19.890620 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:19.890991 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:19.972242 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:19.979576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f8e8bc11-5819-4652-a6e9-2131e21a301c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1285 microversion: 2.1 time: 0.101113 May 16 15:23:19.980143 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 127/251] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:19 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:20.397690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:20.410069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:20.410069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:20.410069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:20.410069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:20.411107 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:20.619804 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:20.630279 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-06ecbd02-f021-410b-8539-c3e5164cd792 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.236235 May 16 15:23:20.631725 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 125/252] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:20 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:21.003534 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:21.005330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:21.011958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.012919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.013815 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.014287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.201626 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:21.214718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6e6442d8-08c0-4048-bd3b-0fbe6b8fc98d tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1315 microversion: 2.1 time: 0.212501 May 16 15:23:21.218020 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 128/253] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:20 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:21.505082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e9294aad-c31a-41cd-a876-1d4b11c48e15 req-3d0c954b-36fb-439a-a8c5-89b0631179ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32227d6d-6cdd-44ac-91ac-acfa0131b44a", "tag": "325a3242-0be5-4d35-bfb5-3a5a8d583822"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:21.523622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e9294aad-c31a-41cd-a876-1d4b11c48e15 req-3d0c954b-36fb-439a-a8c5-89b0631179ea service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.524848 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e9294aad-c31a-41cd-a876-1d4b11c48e15 req-3d0c954b-36fb-439a-a8c5-89b0631179ea service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.545271 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e9294aad-c31a-41cd-a876-1d4b11c48e15 req-3d0c954b-36fb-439a-a8c5-89b0631179ea service nova] Creating event network-changed:325a3242-0be5-4d35-bfb5-3a5a8d583822 for instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a on hv-cinder-79053 May 16 15:23:21.551083 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e9294aad-c31a-41cd-a876-1d4b11c48e15 req-3d0c954b-36fb-439a-a8c5-89b0631179ea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054072 May 16 15:23:21.552047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 126/254] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:21.652369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:21.653344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:21.662488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.662730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.663728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:21.664164 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:21.930408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:21.943053 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-323c1e6e-84c1-4dd0-ac58-c6b5cccd9978 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.299565 May 16 15:23:21.944331 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 129/255] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:21 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:22.235623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:22.236483 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:22.249743 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.250312 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.251218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.252390 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.288023 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b2f6a2ca-2629-4819-a46a-bf43a27736b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:22.300968 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2f6a2ca-2629-4819-a46a-bf43a27736b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.301479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2f6a2ca-2629-4819-a46a-bf43a27736b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.373799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b2f6a2ca-2629-4819-a46a-bf43a27736b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Going to try to stop instance {{(pid=117615) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 15:23:22.522571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:22.552302 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-18d6d8e1-8a5c-4f8e-85ef-fed21757a351 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1315 microversion: 2.1 time: 0.308531 May 16 15:23:22.554943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 127/256] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:22 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:22.616833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b2f6a2ca-2629-4819-a46a-bf43a27736b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action" status: 202 len: 0 microversion: 2.1 time: 0.332440 May 16 15:23:22.617719 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 130/257] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:23:22 2022] POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:23:22.626899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:22.628027 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:22.634303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.634646 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.635417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.636081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.779353 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:22.787376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e39c4be2-9166-406e-a70b-a1bdb360d1c7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.165083 May 16 15:23:22.788120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 128/258] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:22 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:22.960724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:22.961441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:22.968251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.972356 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:22.972356 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:22.972356 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.112594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:23.120434 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-22ebd515-f920-48e9-bab3-38b17bccf8d8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.163888 May 16 15:23:23.121006 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 131/259] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:22 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:23.570667 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:23.571248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:23.581378 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.581874 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.583399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.583833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.714644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:23.722590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-13f358fd-9110-4398-8855-93844cf164ac tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1315 microversion: 2.1 time: 0.155577 May 16 15:23:23.722911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 129/260] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:23 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:23.805150 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:23.805863 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:23.812743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.813227 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.813998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:23.814473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:23.965409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:23.976153 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2656fb7c-fd15-4250-a5b8-c96c6871ca02 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.174912 May 16 15:23:23.976985 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 132/261] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:23 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:24.140830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:24.141445 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:24.147572 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.148224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:24.149184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.149780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:24.346946 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:24.364310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-70a8c72b-6872-48f6-906d-4b3a60a8c34f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.227072 May 16 15:23:24.374001 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 130/262] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:24 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:24.738652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:24.739270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:24.749405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.750949 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:24.752413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:24.754393 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:24.947977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:24.969097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-107590fa-3ef3-4eab-b2c5-b9549d228e25 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1315 microversion: 2.1 time: 0.234471 May 16 15:23:24.981758 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 133/263] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:24 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:24.998613 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:24.999226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:25.005419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:25.005924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:25.006731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:25.007165 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:25.147538 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:25.159337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3a5c4d78-904c-442c-9f5a-34a532fb97a6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.165602 May 16 15:23:25.170618 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 131/264] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:24 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:25.381663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:25.387010 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:25.389177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:25.389635 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:25.390413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:25.390852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:25.547700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:25.556346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d3cd3ea-65e5-4479-b022-aea4c70afe78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.178543 May 16 15:23:25.566190 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 134/265] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:25 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:25.990974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:25.992076 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:25.999360 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:25.999921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.000559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.001127 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.153651 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:26.161104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f4c9861-d765-40b3-b5e1-29cdc7338ea5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1315 microversion: 2.1 time: 0.176750 May 16 15:23:26.161655 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 132/266] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:25 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:26.177639 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:26.178315 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:26.184820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.185328 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.186099 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.186576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.319798 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:26.328127 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-df21ee9c-022c-408b-818f-000304877e42 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.154320 May 16 15:23:26.328691 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 135/267] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:26 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:26.585216 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:26.585924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:26.598120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.601194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.602633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.604959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.758811 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ba556c69-946c-456d-85ca-de1e1f36a5da tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:26.759318 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ba556c69-946c-456d-85ca-de1e1f36a5da tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:26.766576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba556c69-946c-456d-85ca-de1e1f36a5da tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.767317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba556c69-946c-456d-85ca-de1e1f36a5da tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.768142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba556c69-946c-456d-85ca-de1e1f36a5da tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.768771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ba556c69-946c-456d-85ca-de1e1f36a5da tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.769994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:26.779895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d440dfe3-ae92-41de-bc41-595052c3dc4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.199468 May 16 15:23:26.786633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 133/268] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:26 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:26.813504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ba556c69-946c-456d-85ca-de1e1f36a5da tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/ips" status: 200 len: 151 microversion: 2.20 time: 0.059815 May 16 15:23:26.814714 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 136/269] 10.222.0.76 () {60 vars in 1288 bytes} [Mon May 16 15:23:26 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 16 15:23:26.870682 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-90530b2f-dcc3-4b5d-99d7-92cacd3645d6 req-ac9a68af-4f26-4fa3-92e5-a68b75dadbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32227d6d-6cdd-44ac-91ac-acfa0131b44a", "name": "network-vif-plugged", "status": "completed", "tag": "325a3242-0be5-4d35-bfb5-3a5a8d583822"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:26.879862 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-90530b2f-dcc3-4b5d-99d7-92cacd3645d6 req-ac9a68af-4f26-4fa3-92e5-a68b75dadbb9 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:26.880668 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-90530b2f-dcc3-4b5d-99d7-92cacd3645d6 req-ac9a68af-4f26-4fa3-92e5-a68b75dadbb9 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:26.893541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-90530b2f-dcc3-4b5d-99d7-92cacd3645d6 req-ac9a68af-4f26-4fa3-92e5-a68b75dadbb9 service nova] Creating event network-vif-plugged:325a3242-0be5-4d35-bfb5-3a5a8d583822 for instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a on hv-cinder-79053 May 16 15:23:26.899056 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-90530b2f-dcc3-4b5d-99d7-92cacd3645d6 req-ac9a68af-4f26-4fa3-92e5-a68b75dadbb9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 May 16 15:23:26.899978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 134/270] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:27.177958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:27.178535 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:27.184519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.184964 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.185730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.186237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.345691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:27.346464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:27.352441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:27.354286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.354738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.355516 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.355902 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4717308e-b85a-4bd3-8141-8153b74872f2 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1315 microversion: 2.1 time: 0.181575 May 16 15:23:27.356024 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.356621 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 137/271] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:27 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:27.491245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:27.499954 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ead3aa84-8c3d-40a0-8b56-4601795516e3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.158940 May 16 15:23:27.506176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 135/272] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:27 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:27.806872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:27.806872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:27.811904 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.812360 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.813123 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:27.813556 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:27.990192 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:27.999978 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c0ed8b24-4641-4718-8ad1-5f31839c07e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.199849 May 16 15:23:28.000633 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 138/273] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:27 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:28.373335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:28.373954 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:28.380407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.381011 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.381800 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.382261 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.517433 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:28.521792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:28.522442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:28.524909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7334532d-3638-4885-94de-e97154b596d3 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1315 microversion: 2.1 time: 0.156274 May 16 15:23:28.525478 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 136/274] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:28 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:28.528903 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.529400 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.530194 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:28.530695 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:28.662567 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:28.670875 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9287b7f1-617a-49fe-bbf5-5cd404c6dade tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.152850 May 16 15:23:28.671440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 139/275] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:28 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:29.017218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:29.017853 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:29.028982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.028982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.028982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.028982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.175969 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:29.183819 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a67fb1a2-eb63-45ba-ba3e-2b9248694733 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.170810 May 16 15:23:29.184560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 137/276] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:29 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:29.471456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:29.472007 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:29.478069 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.478672 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.479575 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.480099 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.504080 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lazy-loading 'flavor' on Instance uuid 031f5d91-18aa-47bd-a848-e09d19e8f6c4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:23:29.542467 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:29.543110 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:29.549834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.550365 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.551148 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.551610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.706040 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:29.713635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5039ed8c-f15d-4df9-832d-52af70b39841 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1465 microversion: 2.1 time: 0.176010 May 16 15:23:29.714224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 138/277] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:29 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1465 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:29.721546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:29.722405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:29.730528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.731191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.732252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.732749 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.869502 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:29.881750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c2ad3b51-66ad-4128-822c-4b68225dddb0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.166488 May 16 15:23:29.882349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 139/278] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:29 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:29.887620 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:29.888133 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:29.894177 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.894632 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.895398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:29.895837 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:29.936790 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:23:30.160103 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8bce2829-de8a-4b79-8349-c672abfb6b88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/action" status: 202 len: 0 microversion: 2.20 time: 0.692073 May 16 15:23:30.160731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 140/279] 10.222.0.76 () {62 vars in 1318 bytes} [Mon May 16 15:23:29 2022] POST /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/action => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:23:30.169947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:30.170719 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:30.177273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.177716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.178527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.178959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.252932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d4da4ad9-e6a4-458b-a2e3-8601e654d947 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "DELETE /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 204 len: 0 microversion: 2.1 time: 0.369068 May 16 15:23:30.253840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 140/280] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:23:29 2022] DELETE /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:23:30.259455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:30.260153 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:30.266467 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.266921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.267720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.268187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.317367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.327001 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.328752 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.330020 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b31e035c-a962-4f73-b641-f8099bdfc3e5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.164735 May 16 15:23:30.330611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 141/281] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:30 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:23:30.337605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:30.337605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:30.342867 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.343438 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.344217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.344652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.419456 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.423904 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-23d08ffe-f669-4157-8c81-6890e4f66c11 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.168663 May 16 15:23:30.424470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 141/282] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:30 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:30.498734 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:30.506235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c88837d0-0967-46ac-aba9-f01baaeaecd5 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1471 microversion: 2.1 time: 0.174531 May 16 15:23:30.506813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 142/283] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:30 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:30.898761 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:30.899376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:30.906106 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.906592 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:30.907358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:30.907796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.037214 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.046162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3ce5d6e5-a361-43e7-95ef-c4eb52709ed6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.151131 May 16 15:23:31.046742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 142/284] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:30 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:31.349335 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:31.349942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:31.357003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.357452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.358314 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.359168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.441247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:31.442120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:31.448810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.449907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.450778 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.451276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.491695 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.500004 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.501513 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.502738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7011d85-5eef-493a-9d54-412dfacbdf4a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.157430 May 16 15:23:31.503658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 143/285] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:31 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:31.523675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:31.524435 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:31.531049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.531506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.532295 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:31.532733 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:31.582842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.593453 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a2ff70c0-513e-44d1-a1c1-f5d716ed228c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.156440 May 16 15:23:31.594059 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 143/286] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:31 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:31.661494 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:31.668864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c5d950c9-0d08-4f4c-a03d-926b744071d9 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1471 microversion: 2.1 time: 0.149021 May 16 15:23:31.669409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 144/287] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:31 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:32.063790 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:32.064541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:32.071259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.071716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.072499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.072963 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.203956 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:32.211925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-63eb8226-56be-4654-a03c-b9cf9dd639b0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.152110 May 16 15:23:32.212529 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 144/288] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:32 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:32.521529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:32.522064 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:32.528405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.528858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.529619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.530052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.610531 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:32.611151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:32.617203 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.617662 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.618468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.618911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.656137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:32.664122 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:32.665634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:32.666828 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9ac9156b-f721-4e7e-809b-b8670ad6380f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.149369 May 16 15:23:32.667392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 145/289] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:32 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:32.687576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:32.688338 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:32.698162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.698162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.698162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:32.698162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:32.757501 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:32.765369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-24dffd03-03cd-468f-a6a7-55d70a9e885b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.158678 May 16 15:23:32.765937 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 145/290] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:32 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:32.824070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:32.832108 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-af163366-cac2-4d59-9470-9095a7ac755a tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1471 microversion: 2.1 time: 0.149083 May 16 15:23:32.832675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 146/291] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:32 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:33.229975 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:33.230609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:33.237339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.237785 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.238574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.239007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.375711 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.383648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b6567283-1f12-4b84-9f01-4cd179b00b28 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.157563 May 16 15:23:33.384214 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 146/292] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:33 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:33.685336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:33.686288 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:33.692287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.692725 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.693497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.693935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.782592 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:33.783421 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:33.790421 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.790876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.791653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.792093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.827462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.835909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.837713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.838976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5e526254-efb7-45c1-b0c9-750666df237a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.157969 May 16 15:23:33.839545 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 147/293] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:33 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:23:33.851200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:33.855233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:33.858429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.858882 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.859655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:33.860090 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:33.929612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:33.943991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6486429e-f843-4ff0-adaa-1d4313c49052 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.165565 May 16 15:23:33.945077 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 147/294] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:33 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:34.039889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:34.050376 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-32cc09cc-b9a6-4cb2-ab7b-f2a4961eb10c tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1471 microversion: 2.1 time: 0.203136 May 16 15:23:34.051010 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 148/295] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:33 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:34.402526 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:34.403144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:34.410233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.410690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.411470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.411941 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.549956 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:34.561953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-96446f4c-7473-43f1-b647-853d97ae1b09 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.163130 May 16 15:23:34.562642 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 148/296] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:34 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:34.857355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:34.860465 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:34.868937 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.873304 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.873304 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.873304 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.960513 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:34.961223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:34.967159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.967844 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:34.968862 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:34.969459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.103198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.112294 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.114998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.129367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c3bee5b1-4bb4-4fc4-ad71-f14ddfe57d5f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.263930 May 16 15:23:35.129923 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 149/297] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:34 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:35.134897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:35.135558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:35.146025 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.149872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.152375 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.153048 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.263871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.275828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48fe1c0f-92c3-4f65-8160-a92d115a0c06 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.319100 May 16 15:23:35.276878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 149/298] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:34 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:35.280910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.290496 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-dd72bd5c-90f7-49e2-80bb-bf522a5f53f6 req-7bb183d7-d3c6-4b3e-88c9-243fa29cf584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32227d6d-6cdd-44ac-91ac-acfa0131b44a", "name": "network-vif-deleted", "tag": "325a3242-0be5-4d35-bfb5-3a5a8d583822"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:35.290834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3d28a7d9-7c54-4dc3-bae6-aecfd89e3712 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1429 microversion: 2.1 time: 0.158168 May 16 15:23:35.290834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 150/299] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:35 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:35.300426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-dd72bd5c-90f7-49e2-80bb-bf522a5f53f6 req-7bb183d7-d3c6-4b3e-88c9-243fa29cf584 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.301060 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-dd72bd5c-90f7-49e2-80bb-bf522a5f53f6 req-7bb183d7-d3c6-4b3e-88c9-243fa29cf584 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.317882 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-dd72bd5c-90f7-49e2-80bb-bf522a5f53f6 req-7bb183d7-d3c6-4b3e-88c9-243fa29cf584 service nova] Creating event network-vif-deleted:325a3242-0be5-4d35-bfb5-3a5a8d583822 for instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a on hv-cinder-79053 May 16 15:23:35.323788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-dd72bd5c-90f7-49e2-80bb-bf522a5f53f6 req-7bb183d7-d3c6-4b3e-88c9-243fa29cf584 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043589 May 16 15:23:35.324402 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 150/300] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:35.580024 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:35.580835 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:35.587406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.588114 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.589232 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:35.589826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:35.761956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:35.772281 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-576f62a7-deaf-44ce-8155-f08ffaf03a8e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.196832 May 16 15:23:35.779373 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 151/301] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:35 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:36.137398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:36.139194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:36.148454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.148932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.149716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.150170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.288566 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.294287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:36.294948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:36.299571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.301109 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.301377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.301897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.302300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e638fc17-5992-4687-bf50-edecd83f2248 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.169803 May 16 15:23:36.302612 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.302872 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 151/302] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:36 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:36.303054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.308928 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:36.310037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:36.315927 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.316387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.317140 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.317575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.349428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.349886 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.350372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lazy-loading 'fault' on Instance uuid 32227d6d-6cdd-44ac-91ac-acfa0131b44a {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:23:36.391434 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d7434af378b4247aefbe0783cd128c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49f4881c1041528d8071d3cc64a5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.399147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a8eb392d-adee-493a-b2ec-52890191495f tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 200 len: 1305 microversion: 2.1 time: 0.095241 May 16 15:23:36.403644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 152/303] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:36 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:36.432468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.440927 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8ffdad73-02aa-4b68-b5d2-fbdc8a9bccd6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.150545 May 16 15:23:36.443877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 152/304] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:36 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:36.797207 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:36.803936 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:36.804226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.804707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.805738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:36.806201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:36.938849 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:36.946584 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7f22f578-d85f-4c04-9e02-3e99eb3159f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.153713 May 16 15:23:36.947253 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 153/305] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:36 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:37.321639 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:37.322980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.329745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.330231 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.331012 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.331447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.416945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:37.417709 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] [instance: 32227d6d-6cdd-44ac-91ac-acfa0131b44a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.425470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.426112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.427033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.427476 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.442960 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] HTTP exception thrown: Instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a could not be found. May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Request method failure captured: May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a HTTP/1.1 May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmxgz_eaUmUTYElQEyAPYJ5i7WKepBeslIyNwwa1FOnNhONCgjV-fqwJIIXQKYLxC4gCPyb_Fjfa8jgz0nCyIGRl3oPKK99HPXXpw8JomhlKkvXu4-pnjJqpr-2dVX5a8eun21ioNCch1zU_wkwWeDNudI-ZXta4YlODojWmUqul5P0 May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fa49f4881c1041528d8071d3cc64a5b0 May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-1260731578 May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:23:37.444875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fa49f4881c1041528d8071d3cc64a5b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fa49f4881c1041528d8071d3cc64a5b0", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fa49f4881c1041528d8071d3cc64a5b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fa49f4881c1041528d8071d3cc64a5b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-1260731578 May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fa49f4881c1041528d8071d3cc64a5b0 May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-1260731578 May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-1260731578-project May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 5d7434af378b4247aefbe0783cd128c0 May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-1260731578-project May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a could not be found. May 16 15:23:37.452658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '32227d6d-6cdd-44ac-91ac-acfa0131b44a'} May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a could not be found. May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:23:37.453578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a could not be found. May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a could not be found. May 16 15:23:37.454958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:23:37.456053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] Returning 404 to user: Instance 32227d6d-6cdd-44ac-91ac-acfa0131b44a could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:23:37.456053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ed3bff7d-1fe4-4765-9b06-e484308ba858 tempest-VolumesNegativeTest-1260731578 tempest-VolumesNegativeTest-1260731578-project] 10.222.0.76 "GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a" status: 404 len: 111 microversion: 2.1 time: 0.033467 May 16 15:23:37.456053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 154/306] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:37 2022] GET /compute/v2.1/servers/32227d6d-6cdd-44ac-91ac-acfa0131b44a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:23:37.477026 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:37.477159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:37.477760 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.485014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.485469 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.485803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:37.486286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.486727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.487363 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:37.489239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-71f3d88f-0198-4852-901a-abe0abfbf576 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.171362 May 16 15:23:37.489815 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 153/307] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:37 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:37.620342 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:37.628142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f3f0f042-841e-4e36-bf4d-dc3813a5e65e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1500 microversion: 2.1 time: 0.164024 May 16 15:23:37.628794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 155/308] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:37 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:37.645523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "242033d7-b9ea-4b04-b503-ea1605276653"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:37.646679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.659392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.659392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.659392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.659392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.683475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] HTTP exception thrown: Cannot 'attach_volume' instance 5a560909-2499-4a61-8c4e-90438829ff82 while it is in vm_state rescued May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Request method failure captured: May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82/os-volume_attachments HTTP/1.1 May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 74 May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv7qQTE8tLG33ej85dpt73LbP7nYUSJFQ4d_TW8DLi35Kx1Qbez_5294G-bCVt3blhIw7HkMV9SgEmA95NLP9nihR4FJu9fM_RWvQ39NM9g_RsA_tCDanLg4bewbec122zNONg-LfnoskEuA5-IgViyeb7Q7n588qsHtvtbhUPVAUM May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:23:37.686573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c3c3d75e638a4871b548ba689eeddeda", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6c6b9438bb4245b3908664bfece4ef22 May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {"volumeAttachment": {"volumeId": "242033d7-b9ea-4b04-b503-ea1605276653"}} May 16 15:23:37.688137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Cannot 'attach_volume' instance 5a560909-2499-4a61-8c4e-90438829ff82 while it is in vm_state rescued May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'server_id': '5a560909-2499-4a61-8c4e-90438829ff82', 'body': {'volumeAttachment': {'volumeId': '242033d7-b9ea-4b04-b503-ea1605276653'}}} May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a560909-2499-4a61-8c4e-90438829ff82 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:23:37.688925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5a560909-2499-4a61-8c4e-90438829ff82 while it is in vm_state rescued May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:23:37.690068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:23:37.691278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:23:37.691278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:23:37.691278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5a560909-2499-4a61-8c4e-90438829ff82 while it is in vm_state rescued May 16 15:23:37.691278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:23:37.692787 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Returning 409 to user: Cannot 'attach_volume' instance 5a560909-2499-4a61-8c4e-90438829ff82 while it is in vm_state rescued {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:23:37.693663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3e103d12-e5b3-479a-b6c5-311e0d797d2b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052199 May 16 15:23:37.695111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 154/309] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:23:37 2022] POST /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 15:23:37.704685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f1d4a63-21b4-46c4-bcd0-c774687f99a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:37.705219 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2f1d4a63-21b4-46c4-bcd0-c774687f99a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.711365 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f1d4a63-21b4-46c4-bcd0-c774687f99a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.711897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f1d4a63-21b4-46c4-bcd0-c774687f99a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.712728 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f1d4a63-21b4-46c4-bcd0-c774687f99a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.713172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f1d4a63-21b4-46c4-bcd0-c774687f99a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.942070 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f1d4a63-21b4-46c4-bcd0-c774687f99a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82/action" status: 202 len: 0 microversion: 2.1 time: 0.241728 May 16 15:23:37.947774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 156/310] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:23:37 2022] POST /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:23:37.954248 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:37.960177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.965595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:37.966361 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:37.970088 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.972313 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.972877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.973336 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.973655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.974121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:37.974532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:37.974650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:38.143643 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:38.151832 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f44cdec0-0e75-4dce-a22a-e0429e6bc944 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1508 microversion: 2.1 time: 0.204435 May 16 15:23:38.158182 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 155/311] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:37 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:38.162233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:38.179946 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-412d7ae9-a9d3-4264-8771-58586549c65c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.211174 May 16 15:23:38.179946 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 157/312] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:37 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:38.508326 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:38.509493 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:38.516427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:38.516886 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:38.517666 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:38.518389 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:38.695880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:38.705530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:38.707114 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:38.708321 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07e5fcb3-f8c9-4ca9-ab67-591df3919227 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.203890 May 16 15:23:38.708872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 156/313] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:38 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:39.168994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:39.169604 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:39.175776 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.176220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.176998 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.177437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.196080 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:39.196808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:39.204877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.205174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.206418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.207126 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.366035 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:39.373921 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:39.379818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-233d46b6-bee3-46d8-8368-15a98818ecc7 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1508 microversion: 2.1 time: 0.214671 May 16 15:23:39.380407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 158/314] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:39 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:39.386953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-945639c8-4c39-4de0-93b7-fa14885e6e18 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.195190 May 16 15:23:39.388087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 157/315] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:39 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:39.730120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:39.731182 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:39.738669 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.739357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.743633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:39.744176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:39.892363 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:39.902223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:39.902223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:39.903040 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-77834abe-30b2-42c6-b124-615be48500c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.179143 May 16 15:23:39.904090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 159/316] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:39 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:40.400009 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:40.400734 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:40.404722 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:40.405372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:40.407571 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.408022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:40.408801 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.409239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:40.411881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.412414 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:40.413191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.413619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:40.543519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:40.545993 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:40.551910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f46a9307-22cd-4f15-9dd5-81afe1697fec tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1508 microversion: 2.1 time: 0.156069 May 16 15:23:40.552524 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 158/317] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:40 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:40.554472 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eac510a2-d622-4359-b61f-86529b5f60a0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.153574 May 16 15:23:40.555188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 160/318] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:40 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:40.921899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:40.922825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:40.929046 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.929651 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:40.930593 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:40.931032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:41.088392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:41.097786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:41.099467 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:41.100979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a5522714-aac7-477e-aefa-47549f193c2b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.183929 May 16 15:23:41.101731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 159/319] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:40 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:41.571848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:41.572858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:41.573151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:41.574269 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:41.579668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:41.580120 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:41.580887 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:41.581318 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:41.581848 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:41.588184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:41.588184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:41.588184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:41.740558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:41.750410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-86deef66-86e5-40ce-8cb1-7aee4df300f0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1508 microversion: 2.1 time: 0.183938 May 16 15:23:41.760994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 161/320] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:41 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:41.913792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:41.922728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2dc1c340-b447-400d-a8cf-d0caed454028 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.354355 May 16 15:23:41.923489 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 160/321] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:41 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:42.135840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:42.136484 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:42.144437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.144437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:42.144437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.144437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:42.280841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:42.289834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:42.291639 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:42.292964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b7dbc66d-4699-44d4-9bd3-ebe4de85dc2a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.160971 May 16 15:23:42.293722 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 162/322] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:42 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:42.768543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:42.769497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:42.776172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.776716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:42.777547 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.778704 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:42.939473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:42.941725 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:42.942691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:42.949073 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.949468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4bf3c6d0-faa3-40f7-9f2d-72c8c17152d4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1508 microversion: 2.1 time: 0.184874 May 16 15:23:42.950613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 161/323] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:42 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:42.952560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:42.953436 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:42.953897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:43.118621 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:43.130991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48622dd3-0953-4695-9f9c-aeeafeefb2a3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.193176 May 16 15:23:43.131573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 163/324] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:42 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:43.312170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:43.315483 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:43.318840 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:43.319289 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:43.320061 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:43.320492 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:43.477630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:43.489556 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:43.504813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:43.504813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3072d710-6382-47c0-a3a4-dae9b74e289d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.185540 May 16 15:23:43.504813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 162/325] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:43 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:43.971771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:43.972416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:43.979194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:43.979654 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:43.980536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:43.981118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:44.115555 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:44.123637 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5aac74aa-3ad1-48be-b594-4123e6ca3594 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1514 microversion: 2.1 time: 0.155951 May 16 15:23:44.124248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 164/326] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:43 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:44.151358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:44.152169 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:44.161262 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:44.161262 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:44.161565 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:44.162474 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:44.300980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:44.309036 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f187dd6f-af60-4a2a-8b7c-9073136674b1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.162630 May 16 15:23:44.309605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 163/327] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:44 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:44.519713 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:44.520236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:44.526428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:44.526879 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:44.528188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:44.528614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:44.656623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:44.664507 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:44.666012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:44.667213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-45b6e17d-986f-41ab-af0a-6300b31b0f61 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.151631 May 16 15:23:44.668099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 165/328] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:44 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:45.326772 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:45.327381 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:45.333832 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:45.336996 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:45.336996 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:45.336996 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:45.468401 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:45.476164 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e4e6a34a-e6ee-485b-aed3-085e4d0529f2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.153902 May 16 15:23:45.476724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 164/329] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:45 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:45.686860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:45.687477 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:45.693808 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:45.694303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:45.695079 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:45.695519 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:45.822278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:45.831579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:45.833370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:45.834873 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d36cf9e6-5cd6-45db-a5f9-d9fed875d528 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.152434 May 16 15:23:45.835685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 166/330] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:45 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:46.492786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:46.493398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:46.499989 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:46.500436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:46.501211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:46.501638 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:46.630055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:46.638425 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-31b5cd5f-78ad-47d3-a9cb-952ea2f05f6d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1722 microversion: 2.1 time: 0.149486 May 16 15:23:46.638997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 165/331] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:46 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:46.852871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:46.853583 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:46.860207 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:46.860662 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:46.861444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:46.861882 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:46.994958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:47.003759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:47.005610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:47.006831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5061260d-83b9-4418-ad96-767ff8ec9366 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.157819 May 16 15:23:47.008740 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 167/332] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:46 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:47.656499 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:47.657100 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:47.663525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:47.663968 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:47.664727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:47.665152 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:47.795556 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:47.803342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a2fb8f0f-4763-4b32-baf8-b922c7946937 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1699 microversion: 2.1 time: 0.151315 May 16 15:23:47.803899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 166/333] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:47 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:47.820370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d8074bea-2ab4-4172-980f-ffcbaf890718 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:47.827684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8074bea-2ab4-4172-980f-ffcbaf890718 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:47.828184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8074bea-2ab4-4172-980f-ffcbaf890718 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:47.897802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d8074bea-2ab4-4172-980f-ffcbaf890718 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Going to try to start instance {{(pid=117616) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 15:23:48.025567 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:48.026361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:48.032824 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.037497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.037497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.037497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.090893 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d8074bea-2ab4-4172-980f-ffcbaf890718 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action" status: 202 len: 0 microversion: 2.1 time: 0.274140 May 16 15:23:48.092589 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 168/334] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:23:47 2022] POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:23:48.101234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:48.101953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:48.108308 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.108764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.109559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:48.109999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:48.179044 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:48.190486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:48.190486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:48.191519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e2e858a-7f5b-4261-8be6-30922cfa03ce tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.169086 May 16 15:23:48.207589 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 167/335] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:48 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:23:48.259093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:48.280367 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d691df3c-44df-493c-8c7b-155def7046fa tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1708 microversion: 2.1 time: 0.183350 May 16 15:23:48.284298 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 169/336] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:48 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1708 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:48.329951 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f909a8b9-9a7b-48fd-ae02-5bdd152cb997 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'create', calling method: .version_select at 0x7fddb3e883a0>, body: {"keypair": {"name": "tempest-keypair-800306307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz4hcttHjFElqfNBiMZ21/d7WMiBY27XdBWYwdkPOEStviO5SuGsDrD4S/rEeTlClDEbx4BusxHFVbdC0YTqbeC9cFXRETblJNXBMWH2wjBGbKy+YYTU7T8AEGtddhTEw=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:48.345926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-f909a8b9-9a7b-48fd-ae02-5bdd152cb997 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for project c3c3d75e638a4871b548ba689eeddeda. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:23:48.350461 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-f909a8b9-9a7b-48fd-ae02-5bdd152cb997 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for user 6c6b9438bb4245b3908664bfece4ef22 and project c3c3d75e638a4871b548ba689eeddeda. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:23:48.492573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f909a8b9-9a7b-48fd-ae02-5bdd152cb997 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166280 May 16 15:23:48.493382 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 168/337] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:23:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:23:49.211569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:49.212383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:49.219909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:49.220564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:49.221616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:49.222019 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:49.303862 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:49.305051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:49.313924 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:49.313924 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:49.314867 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:49.315818 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:49.526437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:49.544030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:49.546396 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:49.549831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:49.551102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-863c8524-8ba9-4cc9-8cb3-6e58e787afd7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.345107 May 16 15:23:49.554340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-47873d74-b465-4145-8351-da7985828f74 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1708 microversion: 2.1 time: 0.255380 May 16 15:23:49.554853 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 170/338] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:49 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:49.555537 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 169/339] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:49 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1708 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:50.572565 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:50.575830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:50.577238 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:50.577962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:50.584062 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:50.584726 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:50.585540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:50.588355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:50.612118 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:50.612361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:50.617642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:50.618094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:50.800571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:50.809630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:50.811385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:50.812777 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1d747106-f3a9-4fb7-b044-b482b137d624 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.244114 May 16 15:23:50.813659 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 171/340] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:50 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:50.834035 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:50.843155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8b2d8cbe-db10-418c-bb94-ab40d200a28d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1708 microversion: 2.1 time: 0.272283 May 16 15:23:50.843760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 170/341] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:50 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1708 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:51.833000 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:51.833880 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:51.842640 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:51.843443 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:51.844586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:51.845132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:51.868018 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:51.868713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:51.875813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:51.876264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:51.877049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:51.877489 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:52.016668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:52.025170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-af74c5ba-41d4-4207-be99-3d47f29cac50 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1708 microversion: 2.1 time: 0.165807 May 16 15:23:52.025750 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 171/342] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:51 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:52.031671 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1378280892", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c04e7fee-d98e-4604-82f3-3cc633c866f1"}], "security_groups": [{"name": "tempest-securitygroup--809593730"}], "key_name": "tempest-keypair-800306307", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:23:52.097017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:52.106324 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:52.107924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:52.109405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d579e125-76be-4b48-9c6e-5fb3b2b1a72a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.281667 May 16 15:23:52.110038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 172/343] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:51 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:52.145324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] validate_networks() for [('c04e7fee-d98e-4604-82f3-3cc633c866f1', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:23:52.532406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:23:52.532823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:23:52.533296 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:23:52.533727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:23:52.534155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:23:52.543494 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:52.556308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:52.556308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:52.556308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:52.564890 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for project c3c3d75e638a4871b548ba689eeddeda. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:23:52.568987 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Getting quotas for user 6c6b9438bb4245b3908664bfece4ef22 and project c3c3d75e638a4871b548ba689eeddeda. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:23:52.580153 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:23:52.582465 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:23:53.051505 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:53.052737 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:53.059619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:53.060082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:53.060892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:53.061321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:53.064871 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-93adb658-7a38-460d-9837-09d942d4772b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.037881 May 16 15:23:53.066472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 172/344] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:23:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:23:53.076766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e8a70292-7561-47af-8ee3-67856fe5b68b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:53.077387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e8a70292-7561-47af-8ee3-67856fe5b68b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:53.147319 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e8a70292-7561-47af-8ee3-67856fe5b68b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:53.155064 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e8a70292-7561-47af-8ee3-67856fe5b68b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1245 microversion: 2.1 time: 0.082831 May 16 15:23:53.155579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 173/345] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:53 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:53.173547 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:53.174398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:53.182576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:53.182953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:53.189099 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:53.192320 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:53.245057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:53.254046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0e4cc6c6-0764-4b0e-9c01-27721233c6dd tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1712 microversion: 2.1 time: 0.206500 May 16 15:23:53.255329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 173/346] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:53 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1712 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:53.395043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:53.405485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:53.407306 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:53.408754 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-84e0c8f2-0264-4d23-a24b-f30fea02216a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.251983 May 16 15:23:53.409445 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 174/347] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:53 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:54.172245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bcfd7732-1200-445b-9b9f-0b16a7c9ee8c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:54.172946 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bcfd7732-1200-445b-9b9f-0b16a7c9ee8c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:54.234674 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bcfd7732-1200-445b-9b9f-0b16a7c9ee8c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:54.242444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bcfd7732-1200-445b-9b9f-0b16a7c9ee8c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1245 microversion: 2.1 time: 0.074591 May 16 15:23:54.244828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 174/348] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:54 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:54.427820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:54.428429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:54.442035 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:54.442676 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:54.443594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:54.444182 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:54.626271 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:54.635395 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:54.637340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:54.653144 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-21e55b97-4cbd-4963-b2a7-af4c33dd7a11 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.220352 May 16 15:23:54.663828 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 175/349] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:54 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:55.264675 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:55.265631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:55.273052 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:55.273503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:55.274332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:55.274773 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:55.351601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:55.361591 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-071a6471-5280-4af4-a854-83e21046dd2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1249 microversion: 2.1 time: 0.101813 May 16 15:23:55.362545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 175/350] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:55 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:55.683833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:55.685318 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:55.697943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:55.698393 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:55.699735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:55.700229 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:55.951096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:55.967158 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:55.969082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:55.971013 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8b867305-1baf-44b8-b12e-ef5079c33e9a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.300444 May 16 15:23:55.971865 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 176/351] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:55 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:56.378962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:56.379576 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:56.385842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:56.386325 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:56.387127 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:56.387560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:56.449763 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:56.457475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-27926dd6-0a25-4776-80c8-bfb3c3b2d24f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1249 microversion: 2.1 time: 0.082358 May 16 15:23:56.458685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 176/352] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:56 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:56.991258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:56.992034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:56.998898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:56.999544 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:57.000349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:57.000781 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:57.250806 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:57.259660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:57.261257 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:57.263612 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8aa63b8b-bc97-45bb-967f-bf92405aedc2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.277544 May 16 15:23:57.264807 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 177/353] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:56 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:57.483766 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:57.483766 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:57.501441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:57.501934 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:57.502774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:57.503212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:57.650038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:57.658309 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-234763da-66a2-4c50-88ed-8fc89c61f30c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1297 microversion: 2.1 time: 0.185911 May 16 15:23:57.668813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 177/354] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:57 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1297 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:23:58.285516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:58.286311 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:58.296806 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:58.297434 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:58.298323 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:58.298832 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:58.550016 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:58.561506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:58.562260 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:58.564194 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-abea4fb9-54d0-4f92-ac06-74aee7305c47 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.284733 May 16 15:23:58.576100 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 178/355] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:58 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:58.692345 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:58.693065 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:58.700705 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:58.701406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:58.702643 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:58.703796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:58.796318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:58.806181 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7b7fa5ce-a714-4fac-b311-f3a6b8a296cb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1315 microversion: 2.1 time: 0.117769 May 16 15:23:58.806727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 178/356] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:58 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1315 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:23:59.586052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:59.589476 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:59.597078 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:59.597819 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:59.600549 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:59.600549 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:59.821001 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:59.821001 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:59.821186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:59.821186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-775b79ec-5eb5-48ed-8957-3fa233819855 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.209264 May 16 15:23:59.821186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 179/357] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:23:59 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:23:59.826121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:23:59.826994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:23:59.833684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:59.834156 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:59.834950 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:23:59.835383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:23:59.974044 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:23:59.983201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3c3331ac-cd28-4db6-801a-170575ce7c91 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.161318 May 16 15:23:59.984294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 179/358] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:23:59 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:00.810519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:00.814491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:00.819102 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:00.819771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:00.820618 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:00.821132 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:00.993205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:01.000643 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:01.001255 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:01.011484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:01.017141 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:01.019818 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:01.021031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c11d57d3-4e0c-4882-b9d9-73ac061b745d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.214589 May 16 15:24:01.032222 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 180/359] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:00 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:01.032540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:01.032540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:01.032540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:01.169681 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:01.176980 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4cc5dc4a-a520-4129-a2a8-0d00fc5fabaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.180152 May 16 15:24:01.178118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 180/360] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:00 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:02.041166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:02.041780 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:02.052791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:02.053127 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:02.059857 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:02.072694 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:02.195256 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:02.196586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:02.205202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:02.205791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:02.209159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:02.209834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:02.350504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:02.359937 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:02.360334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:02.361511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-256a8562-72dc-423c-93f0-d32cc5942a91 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.325102 May 16 15:24:02.381838 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 181/361] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:02 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:02.505997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-6155ca0b-7be3-4efd-aa21-40385354778a req-9b81ca3f-47c9-4956-9007-4dc24c203f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0316dc2-94eb-4a8c-811e-057cbe5fd20e", "tag": "5932ef72-da59-4163-b091-83604c0d8211"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:02.514761 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:02.523657 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ac9e45fd-0de0-431b-acd6-5143d39a4f66 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.333513 May 16 15:24:02.526458 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 181/362] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:02 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:02.529861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6155ca0b-7be3-4efd-aa21-40385354778a req-9b81ca3f-47c9-4956-9007-4dc24c203f6d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:02.530371 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-6155ca0b-7be3-4efd-aa21-40385354778a req-9b81ca3f-47c9-4956-9007-4dc24c203f6d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:02.572049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-6155ca0b-7be3-4efd-aa21-40385354778a req-9b81ca3f-47c9-4956-9007-4dc24c203f6d service nova] Creating event network-changed:5932ef72-da59-4163-b091-83604c0d8211 for instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e on hv-cinder-79053 May 16 15:24:02.592442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-6155ca0b-7be3-4efd-aa21-40385354778a req-9b81ca3f-47c9-4956-9007-4dc24c203f6d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090452 May 16 15:24:02.597531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 182/363] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:03.380582 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:03.381206 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:03.393266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:03.393947 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:03.395098 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:03.402834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:03.543630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:03.545035 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:03.558679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:03.559889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:03.564692 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:03.565360 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:03.705998 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:03.718015 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:03.720582 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:03.728896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1f357a25-a653-4548-8d51-1686df727cb7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1745 microversion: 2.20 time: 0.352862 May 16 15:24:03.730347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 182/364] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:03 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1745 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:03.818032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:03.827029 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-17452a81-7419-4172-8305-04c931ec78e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.287866 May 16 15:24:03.828132 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 183/365] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:03 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:04.752306 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:04.753354 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:04.763731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:04.764222 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:04.765029 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:04.765466 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:04.845879 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:04.847138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:04.861246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:04.862167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:04.863278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:04.863907 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:04.970373 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:04.982430 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:04.985031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:04.986840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-803e51ed-184f-4259-9afb-082778e76c5d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1745 microversion: 2.20 time: 0.238344 May 16 15:24:04.999180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 183/366] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:04 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:05.091657 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:05.099406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d19542a4-4951-4068-a800-530cedfd428c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.258093 May 16 15:24:05.099913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 184/367] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:04 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:06.007100 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:06.007100 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:06.013240 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:06.013696 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:06.014548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:06.014987 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:06.117504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:06.118847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:06.136713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:06.137878 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:06.138791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:06.139539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:06.257911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:06.269386 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:06.274948 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:06.276679 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-96a419f8-1f92-42fa-a86d-445f3eef1614 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.275616 May 16 15:24:06.289198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 184/368] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:05 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:06.514818 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:06.530944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26ee74e6-4e3f-47f5-a31e-c540f6827d0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.409283 May 16 15:24:06.531900 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 185/369] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:06 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:06.586890 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-da958d6d-f290-49a8-858d-0834a40d1fa0 req-c0aa9b9c-b4db-4b5e-9551-4e94c5f5c760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f5d91-18aa-47bd-a848-e09d19e8f6c4", "name": "network-vif-plugged", "status": "completed", "tag": "a3126c76-9ed9-4501-8584-9b5b2ba2d62e"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:06.601807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-da958d6d-f290-49a8-858d-0834a40d1fa0 req-c0aa9b9c-b4db-4b5e-9551-4e94c5f5c760 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:06.603271 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-da958d6d-f290-49a8-858d-0834a40d1fa0 req-c0aa9b9c-b4db-4b5e-9551-4e94c5f5c760 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:06.624669 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-da958d6d-f290-49a8-858d-0834a40d1fa0 req-c0aa9b9c-b4db-4b5e-9551-4e94c5f5c760 service nova] Creating event network-vif-plugged:a3126c76-9ed9-4501-8584-9b5b2ba2d62e for instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 on hv-cinder-79053 May 16 15:24:06.629895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-da958d6d-f290-49a8-858d-0834a40d1fa0 req-c0aa9b9c-b4db-4b5e-9551-4e94c5f5c760 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050185 May 16 15:24:06.630977 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 185/370] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:07.297917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:07.298572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:07.310097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:07.310566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:07.315877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:07.316834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:07.551159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:07.551885 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:07.600995 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:07.601888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:07.602743 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:07.603190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:07.726097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:07.737028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:07.739557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:07.742861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-08c8ae3d-95ce-4ef4-9bef-770bd7d187f7 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.450315 May 16 15:24:07.744023 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 186/371] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:07 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:07.944707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:07.955143 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-553d2c83-e368-4cd1-a782-a7f600780116 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.409318 May 16 15:24:07.956356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 186/372] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:07 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:08.068194 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-23580ff2-a504-4463-a906-cba3ef9eb5fa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Action: 'create', calling method: .version_select at 0x7fddb3edda60>, body: {"keypair": {"name": "tempest-TestShelveInstance-43022156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtvJueFhTWlg/C8qnk6QCnPSKdVqfVUG5P3wI+eJwmTSpZepVgrGZ3QubLcQcXekz4YdqzMHg9m3TW+c5enGTqAc7N1RNd47peCvOuPdm+fu12WpM55PAGoIDONYP7f/Q=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:08.084176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-23580ff2-a504-4463-a906-cba3ef9eb5fa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Getting quotas for project be817fd143aa4f3b87f6cfd77666cdb7. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:08.088028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-23580ff2-a504-4463-a906-cba3ef9eb5fa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Getting quotas for user 5035b142903440768a5cf79d47fc0d91 and project be817fd143aa4f3b87f6cfd77666cdb7. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:08.409550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-23580ff2-a504-4463-a906-cba3ef9eb5fa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.598419 May 16 15:24:08.409550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 187/373] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:24:07 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:08.761977 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:08.763537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:08.771126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:08.772064 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:08.772944 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:08.775707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:08.979675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:08.981135 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:09.000062 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:09.006580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:09.009872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:09.011918 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:09.073019 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:09.082870 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:09.084526 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:09.085873 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-69235ec3-02cd-4405-9611-8c55ae7f62d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.328596 May 16 15:24:09.090217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 187/374] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:08 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:09.097364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-00d2f7be-9f9d-4f63-a8d9-a09c14bdfa71 req-c3e8d43f-add1-4a9c-a5ca-63818c00562e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0316dc2-94eb-4a8c-811e-057cbe5fd20e", "name": "network-vif-plugged", "status": "completed", "tag": "5932ef72-da59-4163-b091-83604c0d8211"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:09.110711 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-00d2f7be-9f9d-4f63-a8d9-a09c14bdfa71 req-c3e8d43f-add1-4a9c-a5ca-63818c00562e service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:09.115112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-00d2f7be-9f9d-4f63-a8d9-a09c14bdfa71 req-c3e8d43f-add1-4a9c-a5ca-63818c00562e service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:09.130864 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-00d2f7be-9f9d-4f63-a8d9-a09c14bdfa71 req-c3e8d43f-add1-4a9c-a5ca-63818c00562e service nova] Creating event network-vif-plugged:5932ef72-da59-4163-b091-83604c0d8211 for instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e on hv-cinder-79053 May 16 15:24:09.139467 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-00d2f7be-9f9d-4f63-a8d9-a09c14bdfa71 req-c3e8d43f-add1-4a9c-a5ca-63818c00562e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047527 May 16 15:24:09.141816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 188/375] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:09.243642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:09.253522 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1ff35c05-bbb8-4d81-8780-a6e8b67fbd71 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.277434 May 16 15:24:09.257585 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 188/376] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:08 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:10.108624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:10.109312 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:10.121147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.121591 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.127101 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.127616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.279812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:10.280448 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:10.293615 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.294175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.299030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:10.299550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:10.386827 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:10.395871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:10.399107 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:10.400655 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a89b0c7f-9fad-4655-9894-418de121a5c5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.297247 May 16 15:24:10.402459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 189/377] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:10 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:10.510814 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:10.528143 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-92da248d-027a-4390-8101-1eed9fe2e53d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1370 microversion: 2.1 time: 0.258720 May 16 15:24:10.545878 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 189/378] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:10 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:11.425162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:11.425764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:11.433543 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.434829 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:11.442047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.442047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:11.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:11.547178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:11.570263 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.571409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:11.573514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.578278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:11.763772 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:11.780386 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:11.781959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:11.791268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-14dee84e-6928-483b-951c-90db0e8b68b4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.369701 May 16 15:24:11.791716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 190/379] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:11 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:11.897357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:11.907051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30454db8-3f6d-4ff3-aa65-32b3b93867d9 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1563 microversion: 2.1 time: 0.364988 May 16 15:24:11.908422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 190/380] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:11 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1563 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:11.924699 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-57d7035f-f77e-4cc5-8fef-dfcf50bde3ce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:11.925210 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-57d7035f-f77e-4cc5-8fef-dfcf50bde3ce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:11.934443 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57d7035f-f77e-4cc5-8fef-dfcf50bde3ce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.934938 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57d7035f-f77e-4cc5-8fef-dfcf50bde3ce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:11.935641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57d7035f-f77e-4cc5-8fef-dfcf50bde3ce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:11.936091 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57d7035f-f77e-4cc5-8fef-dfcf50bde3ce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:12.078989 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-57d7035f-f77e-4cc5-8fef-dfcf50bde3ce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102221 May 16 15:24:12.078989 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 191/381] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:24:11 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:12.809894 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:12.810526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:12.824485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:12.824967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:12.834396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:12.835389 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:13.241372 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:13.247797 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:13.249302 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:13.250506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-760ad793-ca4e-4b29-be21-d771b70e9c32 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.445056 May 16 15:24:13.251539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 191/382] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:12 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:24:14.256471 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-0f4f59e1-a3cb-42b9-83ea-c22d5d803fd5 req-9e24229c-8a11-4843-bb85-ba4a74cb34cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0316dc2-94eb-4a8c-811e-057cbe5fd20e", "tag": "5932ef72-da59-4163-b091-83604c0d8211"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:14.269574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:14.270226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:14.273597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0f4f59e1-a3cb-42b9-83ea-c22d5d803fd5 req-9e24229c-8a11-4843-bb85-ba4a74cb34cb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:14.274048 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-0f4f59e1-a3cb-42b9-83ea-c22d5d803fd5 req-9e24229c-8a11-4843-bb85-ba4a74cb34cb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:14.292910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:14.292910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:14.292910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:14.292910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:14.330539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-0f4f59e1-a3cb-42b9-83ea-c22d5d803fd5 req-9e24229c-8a11-4843-bb85-ba4a74cb34cb service nova] Creating event network-changed:5932ef72-da59-4163-b091-83604c0d8211 for instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e on hv-cinder-79053 May 16 15:24:14.371617 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-0f4f59e1-a3cb-42b9-83ea-c22d5d803fd5 req-9e24229c-8a11-4843-bb85-ba4a74cb34cb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119294 May 16 15:24:14.372243 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 192/383] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:14.641425 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:14.650571 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:14.652200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:14.653430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8389314b-f641-4fc3-bfec-b3bc329a5d22 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.388631 May 16 15:24:14.654390 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 192/384] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:14 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:24:15.673017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:15.673726 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:15.684920 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:15.685660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:15.686680 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:15.687274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:15.933613 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:15.942317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:15.945380 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:15.965042 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f58d25de-3526-4a23-9ccc-578862984833 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.295458 May 16 15:24:15.976169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 193/385] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:15 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:16.985683 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:16.986816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:16.999422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:17.000139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:17.001095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:17.001687 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:17.273519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:17.274896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:17.276656 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:17.278043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-73b9b383-f88e-4bef-a499-42842db25142 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.298459 May 16 15:24:17.288107 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 193/386] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:16 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:18.300645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:18.301672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:18.310198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:18.310886 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:18.312014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:18.312845 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:18.479600 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:18.487883 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:18.489503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:18.492872 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-845b7fcf-7bf4-4a82-8133-a2fdf5fdd8ff tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.197582 May 16 15:24:18.503402 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 194/387] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:18 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:19.513504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:19.514795 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:19.524493 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:19.528914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:19.532866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:19.533672 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:19.868366 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:19.883511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:19.885325 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:19.894053 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7053038d-c22d-47eb-a7f0-cbcb875f1dda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.385684 May 16 15:24:19.895268 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 194/388] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:19 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:20.922252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:20.924263 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:20.931905 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:20.936606 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:20.943898 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:20.944265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:21.210375 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:21.236482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:21.242312 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:21.243787 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-296c05b6-94d6-4dc4-89f2-f5c1306a3d9f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.334200 May 16 15:24:21.257508 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 195/389] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:20 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:22.265855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:22.266628 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:22.274475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:22.274948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:22.275770 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:22.276718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:22.408853 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:22.417460 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:22.419013 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:22.420179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5f25b6c2-faae-477b-893b-b68069181e4f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.159040 May 16 15:24:22.420728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 195/390] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:22 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:23.439266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:23.439719 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:23.449184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:23.449629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:23.450454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:23.450918 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:23.712203 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:23.720205 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:23.722014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:23.723184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c59208a5-74a6-4de2-80aa-2c55650f3070 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1740 microversion: 2.20 time: 0.288659 May 16 15:24:23.723734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 196/391] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:23 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:24.740749 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:24.741371 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:24.749300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:24.749743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:24.750561 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:24.751095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:24.925827 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:24.935273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:24.936784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:24.938917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c471d322-34fd-41fe-8591-1407f297e8af tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1722 microversion: 2.20 time: 0.202010 May 16 15:24:24.940764 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 196/392] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:24 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:25.966220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:25.966927 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:25.976998 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:25.979358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:25.984833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:25.985549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:26.247270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:26.256150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:26.257917 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:26.259307 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e4552245-9a98-4c9e-838c-85a5806bf6a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1722 microversion: 2.20 time: 0.297122 May 16 15:24:26.260849 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 197/393] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:25 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:27.285645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:27.287250 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:27.315073 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:27.315401 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:27.316195 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:27.316678 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:27.615808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:27.624334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:27.636485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:27.637681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fc1b03b2-7cff-4b95-ae73-7a5edbc97053 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1722 microversion: 2.20 time: 0.357170 May 16 15:24:27.638765 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 197/394] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:27 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:28.658822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:28.659924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:28.669757 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:28.672858 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:28.675423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:28.677656 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:28.715943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-ca62fcf8-d83c-494a-be58-5680db43515b req-3bf8f728-aff9-49ca-b621-a4c4700f4e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f5d91-18aa-47bd-a848-e09d19e8f6c4", "name": "network-vif-unplugged", "status": "completed", "tag": "a3126c76-9ed9-4501-8584-9b5b2ba2d62e"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:28.728916 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-ca62fcf8-d83c-494a-be58-5680db43515b req-3bf8f728-aff9-49ca-b621-a4c4700f4e28 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:28.729362 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-ca62fcf8-d83c-494a-be58-5680db43515b req-3bf8f728-aff9-49ca-b621-a4c4700f4e28 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:28.741645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-ca62fcf8-d83c-494a-be58-5680db43515b req-3bf8f728-aff9-49ca-b621-a4c4700f4e28 service nova] Creating event network-vif-unplugged:a3126c76-9ed9-4501-8584-9b5b2ba2d62e for instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 on hv-cinder-79053 May 16 15:24:28.749559 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-ca62fcf8-d83c-494a-be58-5680db43515b req-3bf8f728-aff9-49ca-b621-a4c4700f4e28 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036960 May 16 15:24:28.750462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 198/395] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:28.940117 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:28.948985 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:28.961632 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:28.961632 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a60c43ce-df97-4cad-b6d3-a2d4b05bea37 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1725 microversion: 2.20 time: 0.299640 May 16 15:24:28.965773 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 198/396] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:28 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:28.971057 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f0e8d101-a2c5-4653-bbbe-3cd5141a4106 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9fd3395-af15-4108-8c32-7d2cab48ea8b"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:28.972729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f0e8d101-a2c5-4653-bbbe-3cd5141a4106 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:28.980420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0e8d101-a2c5-4653-bbbe-3cd5141a4106 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:28.981190 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0e8d101-a2c5-4653-bbbe-3cd5141a4106 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:28.982260 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0e8d101-a2c5-4653-bbbe-3cd5141a4106 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:28.982939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0e8d101-a2c5-4653-bbbe-3cd5141a4106 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.626664 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f0e8d101-a2c5-4653-bbbe-3cd5141a4106 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.660165 May 16 15:24:30.628170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 199/397] 10.222.0.76 () {62 vars in 1363 bytes} [Mon May 16 15:24:28 2022] POST /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments => generated 188 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:24:30.778655 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4dc70163-c45b-46a6-94ea-442433019c07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:30.779214 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4dc70163-c45b-46a6-94ea-442433019c07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:30.786515 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4dc70163-c45b-46a6-94ea-442433019c07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.787189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4dc70163-c45b-46a6-94ea-442433019c07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:30.794738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4dc70163-c45b-46a6-94ea-442433019c07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:30.795297 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4dc70163-c45b-46a6-94ea-442433019c07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.057551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4dc70163-c45b-46a6-94ea-442433019c07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/action" status: 202 len: 0 microversion: 2.20 time: 0.283419 May 16 15:24:31.058315 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 199/398] 10.222.0.76 () {62 vars in 1318 bytes} [Mon May 16 15:24:30 2022] POST /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:24:31.071887 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:31.072675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:31.080951 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.081973 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.083070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:31.083713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:31.217028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.225355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.226894 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:31.228053 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9fe62913-14c4-4b56-9153-93f537b57ee3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1751 microversion: 2.20 time: 0.162071 May 16 15:24:31.228609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 200/399] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:31 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:31.466572 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-683462613", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-43022156", "security_groups": [{"name": "tempest-secgroup-smoke-1626057101"}], "networks": [{"uuid": "04ce934f-d3d9-4ab7-9ebf-533d5c52ac5f"}], "block_device_mapping_v2": [{"uuid": "8652b70e-1351-4341-92e6-37de79c08a06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:31.640924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] validate_networks() for [('04ce934f-d3d9-4ab7-9ebf-533d5c52ac5f', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:24:32.099075 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:24:32.099737 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:24:32.100624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:24:32.101141 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:24:32.102938 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:24:32.113262 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.117660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.118265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.119075 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.148896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Getting quotas for project be817fd143aa4f3b87f6cfd77666cdb7. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:32.156258 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Getting quotas for user 5035b142903440768a5cf79d47fc0d91 and project be817fd143aa4f3b87f6cfd77666cdb7. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:32.246588 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:32.247204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:32.251124 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:24:32.253671 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8652b70e-1351-4341-92e6-37de79c08a06',volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:24:32.257578 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.266795 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.267631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:32.268079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:32.447941 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.463843 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.465725 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.467237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bd0c2525-fd22-4171-95e1-a619404650d1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1751 microversion: 2.20 time: 0.224845 May 16 15:24:32.468157 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 201/400] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:32 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:32.747273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-71803918", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "networks": [{"uuid": "b080d6fb-6f80-4230-8970-1240bdaa9a98"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:32.763609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b188443a-6a50-42ad-a8d9-3c532e9ac3a2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.302130 May 16 15:24:32.764301 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 200/401] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:24:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:24:32.782986 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-033a243e-4cc4-4bf4-957e-a01169cc4d7f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:32.783874 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-033a243e-4cc4-4bf4-957e-a01169cc4d7f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:32.825826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] validate_networks() for [('b080d6fb-6f80-4230-8970-1240bdaa9a98', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:24:32.908398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-033a243e-4cc4-4bf4-957e-a01169cc4d7f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:32.922295 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-033a243e-4cc4-4bf4-957e-a01169cc4d7f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1086 microversion: 2.1 time: 0.145270 May 16 15:24:32.924244 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 201/402] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:32 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1086 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:33.406566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:24:33.408927 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:24:33.409720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:24:33.410309 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:24:33.410836 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:24:33.426558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.433147 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.439610 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.439610 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.486961 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:33.490846 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:33.503241 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Getting quotas for project 66e1e9277cbb4651901cbb84564ef9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:33.513152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.516081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.521087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:33.524904 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:33.525786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Getting quotas for user 0f4f36f69496486ab361b2c308826430 and project 66e1e9277cbb4651901cbb84564ef9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:33.576144 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:24:33.578527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:24:33.726429 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:33.735321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:33.736753 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:33.742829 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7a8f086b-3931-468f-8ecf-3159a7b55526 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1753 microversion: 2.20 time: 0.261694 May 16 15:24:33.744548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 202/403] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:33 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1753 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:33.846111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9021fb9a-a1db-4b17-8873-993afad1a522 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100270 May 16 15:24:33.847788 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 202/404] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:24:33.858407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4cff6b69-79b2-4a6c-a3b1-adc52a4465a0 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:33.859263 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4cff6b69-79b2-4a6c-a3b1-adc52a4465a0 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:33.941334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f6919f5a-df65-419d-9eda-c51d71ace0b5 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:33.942260 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f6919f5a-df65-419d-9eda-c51d71ace0b5 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:33.987527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cff6b69-79b2-4a6c-a3b1-adc52a4465a0 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:34.020117 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4cff6b69-79b2-4a6c-a3b1-adc52a4465a0 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1217 microversion: 2.1 time: 0.160840 May 16 15:24:34.024936 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 203/405] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:33 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:34.060026 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f6919f5a-df65-419d-9eda-c51d71ace0b5 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:34.068269 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f6919f5a-df65-419d-9eda-c51d71ace0b5 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1086 microversion: 2.1 time: 0.132296 May 16 15:24:34.069150 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 203/406] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:33 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1086 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:34.769144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:34.769144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:34.779574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:34.780359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:34.782183 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:34.784125 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:35.041142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:35.042942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d595c931-3f4a-480b-b320-2eae62b4aac6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:35.044464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d595c931-3f4a-480b-b320-2eae62b4aac6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:35.056552 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:35.074547 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:35.076997 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7c4651a8-319e-4c20-a63f-b6b901ab3ed4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1753 microversion: 2.20 time: 0.317472 May 16 15:24:35.090483 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 204/407] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:34 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1753 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:35.114814 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:35.117147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:35.133613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d595c931-3f4a-480b-b320-2eae62b4aac6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:35.136391 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:35.141542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:35.141542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:35.141542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:35.144116 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d595c931-3f4a-480b-b320-2eae62b4aac6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1217 microversion: 2.1 time: 0.108329 May 16 15:24:35.145517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 204/408] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:35 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:35.226159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:35.235716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-17af15fb-3ef0-4674-9af2-0278c63fee1a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1136 microversion: 2.1 time: 0.143957 May 16 15:24:35.236704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 205/409] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:35 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1136 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:36.097056 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:36.097756 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:36.108316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.108943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.110495 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.111198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.160989 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:36.164551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:36.170145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.170834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.171836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.172427 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.250405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.262302 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f5fc42bd-75ec-42c5-abb2-c32f4f33183c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1221 microversion: 2.1 time: 0.104961 May 16 15:24:36.273341 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 206/410] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:36 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:36.280769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:36.281777 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:36.292805 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.303236 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.308862 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.309554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.310253 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.310917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8a180158-b56b-4536-a898-af1deca62306 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.217670 May 16 15:24:36.311544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:36.312162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:36.312748 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 205/411] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:36 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:36.388991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:36.398153 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d8869294-20be-40f0-b133-5eba63b50e64 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1184 microversion: 2.1 time: 0.122787 May 16 15:24:36.400028 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 207/412] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:36 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1184 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:37.280963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:37.281582 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:37.297433 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.297896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.299275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.299744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.330117 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:37.337059 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:37.354230 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.355280 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.357757 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.361960 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.483629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:37.491813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-255bd1f9-0a16-4e02-87d5-37e578f913bc tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1213 microversion: 2.1 time: 0.214674 May 16 15:24:37.492438 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 206/413] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:37 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1213 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:37.503402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:37.504490 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:37.512953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.513858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.514540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:37.515237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:37.639732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:37.655843 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cd452e24-88f2-41a7-b641-19daef250117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1202 microversion: 2.1 time: 0.162047 May 16 15:24:37.656629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 207/414] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:37 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:38.022178 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.034717 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.036543 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.038292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-39b7bf6f-6d04-4264-a49e-3ea70ecfabf9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.713203 May 16 15:24:38.051670 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 208/415] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:37 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:38.509897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:38.510571 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:38.522698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.523165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.523927 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.524538 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.648749 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.661084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4ff36820-bcc1-45e1-a1e6-160a641fadc6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1275 microversion: 2.1 time: 0.154900 May 16 15:24:38.661892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 208/416] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:38 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:38.674917 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:38.677267 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:38.687907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.688459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.689245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:38.691371 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:38.795657 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:38.803112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4ea1587a-4664-4d36-9113-26879a178a33 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1202 microversion: 2.1 time: 0.133869 May 16 15:24:38.803705 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 209/417] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:38 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1202 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:39.060477 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:39.060477 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:39.069715 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.070187 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.070976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.071414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.295628 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.295628 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.297655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.299158 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30915d1a-9ce1-49c8-a092-7d117c4b8322 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.246268 May 16 15:24:39.302170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 209/418] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:39 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:39.684778 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:39.685461 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:39.692242 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.692697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.693541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.693986 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.769867 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.777815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d79a3472-0355-4338-9121-551ba2585a47 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1275 microversion: 2.1 time: 0.096950 May 16 15:24:39.778429 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 210/419] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:39 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:39.819788 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:39.820320 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:39.827478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.827931 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.828729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:39.829164 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:39.971681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:39.982364 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-535f68cf-ce97-4af5-a6b2-0024adb53f00 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.166422 May 16 15:24:39.982936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 210/420] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:39 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:40.318825 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:40.319553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:40.329069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.329522 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.331638 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.332098 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.669212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.681112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.683809 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:40.685137 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f44efed9-80d1-474b-96dc-a9bd7a8f641c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.370266 May 16 15:24:40.687351 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 211/421] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:40 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:40.797379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:40.798732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:40.808386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.814830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.814830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:40.814830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:40.977212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-8d6cacf4-cd59-4a18-82fa-ec188b9709a2 req-b84be36c-7ef6-4b67-ab62-398bc966439f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e9b501-f7d9-4696-a6c2-c1930221431a", "tag": "63eb5f5f-0157-446b-b8eb-bc09b2fc4125"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:41.003057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8d6cacf4-cd59-4a18-82fa-ec188b9709a2 req-b84be36c-7ef6-4b67-ab62-398bc966439f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.006093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8d6cacf4-cd59-4a18-82fa-ec188b9709a2 req-b84be36c-7ef6-4b67-ab62-398bc966439f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.035096 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-8d6cacf4-cd59-4a18-82fa-ec188b9709a2 req-b84be36c-7ef6-4b67-ab62-398bc966439f service nova] Creating event network-changed:63eb5f5f-0157-446b-b8eb-bc09b2fc4125 for instance 26e9b501-f7d9-4696-a6c2-c1930221431a on hv-cinder-79053 May 16 15:24:41.048221 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-8d6cacf4-cd59-4a18-82fa-ec188b9709a2 req-b84be36c-7ef6-4b67-ab62-398bc966439f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076447 May 16 15:24:41.049524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 212/422] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:41.062931 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:41.070877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:41.085165 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.085859 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.086480 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.086924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.177369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:41.193261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e80a36a3-85a0-4890-9c67-250a666d0109 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.397431 May 16 15:24:41.194817 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 211/423] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:40 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:41.210223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:41.213763 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:41.235254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.238200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.243010 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:41.246637 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:41.505490 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lazy-loading 'services' on Instance uuid ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:24:41.964937 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4b7e0beb-1f36-4618-aea0-cea1422716ce tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-volume_attachments/9f608ba5-68f0-4d92-9491-504e13612935" status: 202 len: 0 microversion: 2.1 time: 0.765910 May 16 15:24:41.965896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 212/424] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:24:41 2022] DELETE /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-volume_attachments/9f608ba5-68f0-4d92-9491-504e13612935 => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:24:41.987189 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:41.989908 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:42.017551 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.018618 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.024473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.024930 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.317950 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:42.328727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:42.330734 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:42.332266 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-160d2b63-b5c4-4b17-96bb-73a89ecafd5b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.365075 May 16 15:24:42.333109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 213/425] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:41 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:42.334959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:42.340546 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:42.341630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:42.347940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b520b494-feec-482b-915c-40e43b6dad97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 1.296774 May 16 15:24:42.348770 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 213/426] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:41 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:42.350166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.350166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.359294 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:42.359294 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:42.566460 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:42.578661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3f648916-dfda-4547-8087-197e958cdba1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.240150 May 16 15:24:42.579326 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 214/427] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:42 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:43.070992 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-92a8065c-1954-4417-95af-18ffe78ba2ea req-9ce68419-3024-4d4f-8e04-5148a71ed632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc", "tag": "c7745a72-d5fd-48e6-8037-08c5e91923d2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:43.092946 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-92a8065c-1954-4417-95af-18ffe78ba2ea req-9ce68419-3024-4d4f-8e04-5148a71ed632 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.093603 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-92a8065c-1954-4417-95af-18ffe78ba2ea req-9ce68419-3024-4d4f-8e04-5148a71ed632 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.133187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-92a8065c-1954-4417-95af-18ffe78ba2ea req-9ce68419-3024-4d4f-8e04-5148a71ed632 service nova] Creating event network-changed:c7745a72-d5fd-48e6-8037-08c5e91923d2 for instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc on hv-cinder-79053 May 16 15:24:43.140470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-92a8065c-1954-4417-95af-18ffe78ba2ea req-9ce68419-3024-4d4f-8e04-5148a71ed632 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072113 May 16 15:24:43.141916 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 214/428] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:43.351205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:43.355204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:43.369780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:43.372364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:43.379419 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.379935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.380836 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.385868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.386764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.387264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.387746 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.391816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.786616 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:43.798756 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:43.809981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:43.809981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a664c308-e070-45e1-ae93-e6c50371bf98 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.458412 May 16 15:24:43.809981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 215/429] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:43 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:43.839133 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:43.850056 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:43.858414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.865455 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:43.866607 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:43.867135 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:44.118506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:44.134941 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3e7515db-2c20-4dba-8a80-ccfd7c7047e5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.311535 May 16 15:24:44.135372 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 216/430] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:43 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:44.432121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:44.432121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e6f99992-243f-459e-bff3-81a69a22afdf tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 1.044574 May 16 15:24:44.432121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 215/431] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:43 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:44.436307 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e9421169-da3c-4472-af98-98c42872aa56 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:44.445530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9421169-da3c-4472-af98-98c42872aa56 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:44.445530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9421169-da3c-4472-af98-98c42872aa56 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:44.469786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e9421169-da3c-4472-af98-98c42872aa56 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Going to try to stop instance {{(pid=117615) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 16 15:24:44.828199 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:44.828805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:44.834878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:44.835336 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:44.836104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:44.836533 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.063151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:45.071659 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:45.073251 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:45.074461 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-535337d8-a319-43c6-8ce0-42040c2b5748 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.250172 May 16 15:24:45.078194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 216/432] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:44 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:24:45.092587 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e9421169-da3c-4472-af98-98c42872aa56 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action" status: 202 len: 0 microversion: 2.1 time: 0.666139 May 16 15:24:45.094546 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 217/433] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:24:44 2022] POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:24:45.110623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:45.111606 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:45.121421 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.122158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.123132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.123726 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.152720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:45.153736 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:45.161839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.162172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.167165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.167622 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.283143 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:45.296429 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bb325375-82ab-4392-aaa4-8509e89dda26 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.193468 May 16 15:24:45.297192 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 217/434] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:45 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:45.326772 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:45.339233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-69b5ab1a-8651-4c8f-84e0-6cc55a5e1bc4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.190288 May 16 15:24:45.346677 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 218/435] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:45 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:45.437845 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:45.439868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:45.451031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.451679 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.452810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:45.453407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:45.665765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:45.682444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-14fc816f-8c2f-4da1-acd4-8237c43d5853 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.248427 May 16 15:24:45.683641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 218/436] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:45 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:46.092443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:46.093110 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:46.099745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.100183 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.100950 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.101379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.239487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:46.247909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:46.249415 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:46.250601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-19913be2-1936-4eb2-9042-2ffe7ed9c2e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.162135 May 16 15:24:46.251163 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 219/437] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:46 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:46.314249 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:46.314945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:46.320981 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.321425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.322378 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.322813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.356338 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:46.356877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:46.363146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.363591 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.364374 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.364808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.458037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:46.467068 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3df22fa5-bbfd-4528-bbe8-5037c4d8ee91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.157021 May 16 15:24:46.467855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 219/438] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:46 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:46.472686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2fc3bbaa-0abe-4847-8843-804733761e6e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Action: 'create', calling method: .version_select at 0x7fddb3f1f1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1074292840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE6o8qi+3/VZfXYdwyfwbU4bDi4n3Be/AN8bvMHqt0fLF2FnV9TaX7GHa9s3HmyAYmsxkaJGoFRp3/jTUuB2MB0YO4U9yrlDqpAUmWcNWRsd1uBQJus95EgQ5zlKK8oWw=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:46.491288 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2fc3bbaa-0abe-4847-8843-804733761e6e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Getting quotas for project 65e5f9f015814278b1062e2d7d681cc5. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:46.498115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2fc3bbaa-0abe-4847-8843-804733761e6e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Getting quotas for user 816ac740698548b1b25826fe5168a62a and project 65e5f9f015814278b1062e2d7d681cc5. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:46.504104 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:46.511997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f5950e35-b2da-4ba2-9646-0ccd0b99ff89 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.160129 May 16 15:24:46.512596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 220/439] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:46 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:46.649194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2fc3bbaa-0abe-4847-8843-804733761e6e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.180250 May 16 15:24:46.649795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 220/440] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:24:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:24:46.699291 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-555781853", "imageRef": "a49421be-48f8-4db1-9462-aabfd5bd5353", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1074292840", "networks": [{"uuid": "7c715965-76e1-4d2e-a9a7-e8a6f7926556"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:46.699899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:46.700578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:46.707588 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.708047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.708835 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:46.709279 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:46.748432 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] validate_networks() for [('7c715965-76e1-4d2e-a9a7-e8a6f7926556', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:24:46.880694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:46.890522 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-69bff811-6700-4da9-8be6-a678a0d89bfa tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.195494 May 16 15:24:46.900091 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 221/441] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:46 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:47.172939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:24:47.173424 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:24:47.173822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:24:47.174256 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:24:47.174670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:24:47.184220 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.184669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.185472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.185910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.203254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Getting quotas for project 65e5f9f015814278b1062e2d7d681cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:24:47.207236 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Getting quotas for user 816ac740698548b1b25826fe5168a62a and project 65e5f9f015814278b1062e2d7d681cc5. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:24:47.219187 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:24:47.221586 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a49421be-48f8-4db1-9462-aabfd5bd5353',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:24:47.268771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:47.274465 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:47.276101 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.276548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.277313 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.277749 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.392282 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-726e35b7-e2d4-4644-a6ad-c73f1c383578 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697617 May 16 15:24:47.392944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 221/442] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:24:47.411683 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2f28c42c-b043-40f5-a6b3-ade1a43e2381 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:47.412261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f28c42c-b043-40f5-a6b3-ade1a43e2381 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:47.428123 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:47.437212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:47.438969 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:47.440144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4e675447-851b-4b72-ab65-3ab34a880bcb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.175277 May 16 15:24:47.440907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 222/443] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:47 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:24:47.482936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2f28c42c-b043-40f5-a6b3-ade1a43e2381 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:47.487614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:47.487614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:47.490943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2f28c42c-b043-40f5-a6b3-ade1a43e2381 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1258 microversion: 2.1 time: 0.091804 May 16 15:24:47.491711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 222/444] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:47 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:47.498894 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.499759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.500791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.501449 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.529480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:47.530292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:47.540279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.540279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.540279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.540667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.704754 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:47.713574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a992d60c-7dee-4420-b035-7af581b90b55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.232305 May 16 15:24:47.714229 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 223/445] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:47 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:47.735409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:47.744487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6b7874b4-61f1-404c-bc45-0623143290e4 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.218802 May 16 15:24:47.745680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 223/446] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:47 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:47.907298 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:47.907912 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:47.914286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.914743 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:47.916113 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:47.916746 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.071190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.079098 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2e4fe313-0a7e-45e9-8982-81290f2a6d96 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.175647 May 16 15:24:48.079871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 224/447] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:47 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:48.459214 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:48.459970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:48.466703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.467145 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.467940 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.468365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.509544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-44bef65b-fb47-41a0-9a6a-ab816a35eb05 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:48.514305 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-44bef65b-fb47-41a0-9a6a-ab816a35eb05 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:48.594975 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44bef65b-fb47-41a0-9a6a-ab816a35eb05 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.605284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-44bef65b-fb47-41a0-9a6a-ab816a35eb05 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1258 microversion: 2.1 time: 0.099866 May 16 15:24:48.605832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 225/448] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:48 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1258 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:48.652351 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.665165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.666745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.667926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9494caa7-8328-48cb-9fad-64906fac28c2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.212922 May 16 15:24:48.668475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 224/449] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:48 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:24:48.731192 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:48.731820 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:48.738309 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.744978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.744978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.744978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.764206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:48.765961 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:48.772551 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.773010 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.773831 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:48.774296 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:48.974873 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.994523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:48.995310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0147250c-1c08-4e51-8aea-92467717b3f9 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.255830 May 16 15:24:48.995310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 226/450] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:48 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:48.995630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a6517ba4-bf0f-425d-b427-34e149a1feba tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.228676 May 16 15:24:48.995630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 225/451] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:48 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:49.096144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:49.096781 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:49.105920 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.105920 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.105920 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.105920 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.280853 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:49.289499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aa707c31-9645-4c06-bbc7-1c127c6f536d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.197063 May 16 15:24:49.299032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 227/452] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:49 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:49.623187 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:49.623823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:49.630322 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.630770 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.631560 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.631993 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.686919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:49.688295 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:49.700236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.700694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.701529 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:49.701967 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:49.724310 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:49.733713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-66a300fc-5841-43f3-90ed-5229cdde83cb tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1262 microversion: 2.1 time: 0.115289 May 16 15:24:49.744660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 226/453] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:49 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1262 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:49.856290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:49.865125 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:49.866800 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:49.868041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-41455598-10ea-40e1-9602-a6c62adc670c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.185040 May 16 15:24:49.869260 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 228/454] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:49 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:50.010740 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:50.011641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:50.013389 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:50.013923 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:50.020082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.020537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.021392 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.021869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.024253 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.024943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.025740 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.026272 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.194467 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:50.202855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c0de69a9-967a-46b6-9141-81f97b78589a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.196437 May 16 15:24:50.203783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 227/455] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:50 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:50.221533 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:50.230174 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e10e8265-35b5-4d01-8f34-6a186a53e566 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.221339 May 16 15:24:50.230891 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 229/456] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:50 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:50.306946 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:50.307713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:50.314044 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.314559 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.315346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.315780 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.658562 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:50.666350 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f82064dd-6730-4572-80b3-f732ccc1f76a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.363429 May 16 15:24:50.666910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 228/457] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:50 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:50.751738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:50.752346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:50.758988 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.759597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.767634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.768178 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.836058 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:50.844274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9106535c-ed97-48ec-86f3-2e2669f5a325 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1262 microversion: 2.1 time: 0.096199 May 16 15:24:50.846825 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 230/458] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:50 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1262 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:50.887824 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:50.888529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:50.894781 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.895318 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:50.896187 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:50.896714 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.064193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.065600 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e74ada84-8ce1-4e80-b6ae-1e5be9726230 req-4f61a363-ed26-4b11-b31c-9a72b1b5f522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc", "name": "network-vif-plugged", "status": "completed", "tag": "c7745a72-d5fd-48e6-8037-08c5e91923d2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:51.073519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.074067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e74ada84-8ce1-4e80-b6ae-1e5be9726230 req-4f61a363-ed26-4b11-b31c-9a72b1b5f522 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.074551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e74ada84-8ce1-4e80-b6ae-1e5be9726230 req-4f61a363-ed26-4b11-b31c-9a72b1b5f522 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.075070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.076248 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2e2ea12-764e-4650-8400-7163a07ebc5a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.192932 May 16 15:24:51.076974 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 229/459] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:50 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:51.091302 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e74ada84-8ce1-4e80-b6ae-1e5be9726230 req-4f61a363-ed26-4b11-b31c-9a72b1b5f522 service nova] Creating event network-vif-plugged:c7745a72-d5fd-48e6-8037-08c5e91923d2 for instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc on hv-cinder-79053 May 16 15:24:51.096578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e74ada84-8ce1-4e80-b6ae-1e5be9726230 req-4f61a363-ed26-4b11-b31c-9a72b1b5f522 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035063 May 16 15:24:51.097355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 231/460] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:51.219781 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:51.220408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:51.227234 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.227852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.228931 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.229481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.248548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:51.249440 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:51.259099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.260170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.260951 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.261393 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.372944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.382067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1ea8b4af-fe37-44d1-bd83-b72bca599635 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.166016 May 16 15:24:51.395934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 230/461] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:51 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:51.397168 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.406696 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a5f5ff9d-1dfb-43a9-bfd3-adcebe81b2b6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.163144 May 16 15:24:51.407839 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 232/462] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:51 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:51.682275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:51.682875 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:51.689213 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.689663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.690461 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.690900 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.827535 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.835933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0c50b40f-f675-446d-bbde-17eef15c9707 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.157384 May 16 15:24:51.836523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 231/463] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:51 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:51.861585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:51.862362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:51.869308 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.869758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.870833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:51.871273 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:51.933869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:51.941284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-358a2166-a206-488e-8268-9d0148ddca63 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1262 microversion: 2.1 time: 0.084306 May 16 15:24:51.941853 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 233/464] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:51 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:52.094301 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.094909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.100855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.101308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.102075 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.102535 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.236238 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:52.245882 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:52.247448 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:52.248611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2bbe367b-1e9d-45ea-99f8-c918da531ab4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.158514 May 16 15:24:52.249165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 232/465] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:52.400120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.400735 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.406648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.407097 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.407884 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.408316 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.426064 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.426704 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.433159 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.433538 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.434333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.434767 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.536700 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:52.544545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ad9d100f-27f0-4f8f-97cf-c8e56bdbdf23 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.148200 May 16 15:24:52.545324 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 234/466] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:52.570712 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:52.577999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f69039a4-1f1d-45b8-a5cf-9c032303a0d9 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.155817 May 16 15:24:52.581799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 233/467] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:52.852812 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.853336 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.863379 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.863973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.864589 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.865022 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.960220 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:52.961031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:52.967544 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.974240 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.974240 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:52.974240 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:52.995431 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.002817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cd37df8b-8ad1-4e23-9dbb-c8d2b3ff87d9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.153963 May 16 15:24:53.003524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 235/468] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:53.029908 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.037439 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f1ac37b5-eaf1-4dbd-9ef7-c762033b0427 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1262 microversion: 2.1 time: 0.081339 May 16 15:24:53.038002 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 234/469] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:52 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:53.266929 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:53.267551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:53.274740 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.275197 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.275981 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.276420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.439847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.448542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.450082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.451296 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-658b51f5-8014-49e8-ace1-4d4f1de9620f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.188277 May 16 15:24:53.451847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 236/470] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:53 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:53.561890 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:53.562644 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:53.568601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.569055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.569822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.570286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.596594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:53.597285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:53.604072 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.604718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.605568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:53.606066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:53.700500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.707844 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-034f2ec1-9d0e-4a5f-ae76-be8007e32530 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.149819 May 16 15:24:53.708416 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 235/471] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:53 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:53.738875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:53.746316 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4886c896-3cbc-4bff-9c7b-742b17a92b6d tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.153438 May 16 15:24:53.746866 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 237/472] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:53 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:54.019795 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:54.020411 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:54.027328 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.027778 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.028543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.028980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.053382 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:54.054079 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:54.060435 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.060877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.061638 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.062070 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.123837 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.131050 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5f50730c-f924-40b1-9040-5cee8ff753f1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1310 microversion: 2.1 time: 0.081527 May 16 15:24:54.131843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 238/473] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:54 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:54.157825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.165234 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7be14b9-2852-4166-af12-1a2429ce8aff tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.149271 May 16 15:24:54.165807 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 236/474] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:54 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:54.469108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:54.469712 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:54.475860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.476308 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.477074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.477510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.605581 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.613945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.615493 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.616662 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4f248e33-484e-4ae1-be0a-ceb7f5841a5e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.151451 May 16 15:24:54.617204 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 239/475] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:54 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:54.724782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:54.725309 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:54.731769 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.738270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.738270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.738270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.770375 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:54.770375 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:54.774317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.775513 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.775771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:54.776188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:54.862329 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.871387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0060ab2d-d434-4ad3-9e52-2cd94263e737 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.150513 May 16 15:24:54.871978 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 237/476] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:54 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:54.911961 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:54.919848 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-20d70926-8652-4395-bdcb-293d997c2070 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1317 microversion: 2.1 time: 0.161632 May 16 15:24:54.920412 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 240/477] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:54 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:55.148500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:55.149116 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:55.156409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.156857 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.157644 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.158077 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.181764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:55.186346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:55.189015 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.189586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.190392 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.190896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.232124 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:55.240597 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3778fd4f-5a19-418f-bf8a-6e5f5cb17a74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1318 microversion: 2.1 time: 0.095862 May 16 15:24:55.243846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 238/478] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:55 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:55.391209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:55.400200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-83261dbc-52b6-48f5-a2b7-836394751d55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.221612 May 16 15:24:55.401662 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 241/479] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:55 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:55.634958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:55.635563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:55.641511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.641956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.642745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.643175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.807483 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:55.817433 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:55.818988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:55.820260 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5a91c09b-ff28-4f75-9fbb-570deddea0e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.189220 May 16 15:24:55.820808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 239/480] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:55 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:55.888527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:55.889177 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:55.895025 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.895498 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.896243 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.896680 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.935985 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:55.936520 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:55.942565 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.949146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:55.949146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:55.949146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.101566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:56.112343 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:56.126613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f7c8ea6c-6d59-49c2-bf8c-bf8b90145c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1507 microversion: 2.1 time: 0.194461 May 16 15:24:56.127392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 240/481] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:55 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:24:56.145719 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cd2db56f-72d3-4476-af7a-22594d397bd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.256579 May 16 15:24:56.146689 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 242/482] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:55 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:56.261245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:56.262815 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:56.280369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.281161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.281993 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.282822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.301895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0ace1cc1-3597-499c-bfe0-11497ecaa8fb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0906d85b-9ce3-4953-a020-47169db7ed4d"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:56.301895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0ace1cc1-3597-499c-bfe0-11497ecaa8fb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:56.305215 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ace1cc1-3597-499c-bfe0-11497ecaa8fb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.307322 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ace1cc1-3597-499c-bfe0-11497ecaa8fb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.308823 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ace1cc1-3597-499c-bfe0-11497ecaa8fb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.312072 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ace1cc1-3597-499c-bfe0-11497ecaa8fb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.595929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:56.611433 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-99c418af-d361-457e-9d46-9e4f74ad4048 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.356502 May 16 15:24:56.613287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 241/483] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:56 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:56.632958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:56.635331 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:56.651605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.653007 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.654448 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.655357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.914889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:56.924167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1bb7c222-8fdc-4e82-9b95-2a7e19b7569c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.308981 May 16 15:24:56.936164 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 242/484] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:56 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:56.941643 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:56.942347 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:56.948850 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.949296 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:56.951068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:56.951068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.154979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:57.172643 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:57.174821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:57.176126 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e09eb95a-c119-4f6b-98d7-284c256b9af9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.238621 May 16 15:24:57.176941 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 243/485] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:56 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:57.195327 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:57.196017 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:57.203579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.204028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.205303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.206025 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.340627 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0ace1cc1-3597-499c-bfe0-11497ecaa8fb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.052443 May 16 15:24:57.342426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 243/486] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:24:56 2022] POST /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments => generated 194 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:57.603700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:57.628222 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c21555b6-6833-4d4c-9107-35ba17e5f88a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.449626 May 16 15:24:57.628659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 244/487] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:57 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:57.631442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:57.632240 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:57.641893 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.642618 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.643414 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.643864 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.816440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-454e422e-4e99-4fff-a1d5-14e199b98195 req-4fd05901-490a-4c78-9b7c-9455e713702a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5887d24b-6885-49f4-99d0-7f99f99536cc", "tag": "7f2dac2d-8507-4083-81bf-4f66b2f74796"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:24:57.826019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-454e422e-4e99-4fff-a1d5-14e199b98195 req-4fd05901-490a-4c78-9b7c-9455e713702a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.826937 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-454e422e-4e99-4fff-a1d5-14e199b98195 req-4fd05901-490a-4c78-9b7c-9455e713702a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.842020 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-454e422e-4e99-4fff-a1d5-14e199b98195 req-4fd05901-490a-4c78-9b7c-9455e713702a service nova] Creating event network-changed:7f2dac2d-8507-4083-81bf-4f66b2f74796 for instance 5887d24b-6885-49f4-99d0-7f99f99536cc on hv-cinder-79053 May 16 15:24:57.849844 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-454e422e-4e99-4fff-a1d5-14e199b98195 req-4fd05901-490a-4c78-9b7c-9455e713702a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037557 May 16 15:24:57.850952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 245/488] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:24:57.872821 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:57.891193 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db165af1-a834-47d7-8c6d-4fb74282cf41 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.264055 May 16 15:24:57.912208 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 244/489] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:57 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:57.946949 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:57.948272 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:57.968294 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.968872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:57.973162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:57.973162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.165947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:58.174498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-30c24329-7378-4690-90e1-d69bf77ded49 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.234319 May 16 15:24:58.175344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 246/490] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:57 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:58.194619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:58.195689 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:58.203113 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.203568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.204355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.204991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.385815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:58.398803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:58.400346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:58.401735 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c7c5714b-af77-4b98-877c-734359fb6280 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.211115 May 16 15:24:58.402786 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 245/491] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:58 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:58.645904 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:58.646628 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:58.653943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.654561 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.655570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.656068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.817095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:58.828738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0a1a5234-bca9-4ba0-b1df-49da07e3cac4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.186683 May 16 15:24:58.829958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 247/492] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:58 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:58.911236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:58.911236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:58.929579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.930489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:58.931863 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:58.932755 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.085042 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:59.093688 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2d90f13d-7f25-43e4-8405-cd3ca4936f26 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.186966 May 16 15:24:59.103747 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 246/493] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:58 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:59.192412 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:59.193406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:59.200486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.201267 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.202323 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.202868 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.339022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:59.348244 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-85cc2abd-d6d7-43d2-9cae-0da873f87d9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.159769 May 16 15:24:59.357662 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 248/494] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:59 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:24:59.420782 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:59.421398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:59.427364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.427837 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.428754 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.429283 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.602799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:59.611779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:59.613342 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:24:59.614760 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6f6e1ded-701c-4f6f-b554-25e7c3f19cdf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.198100 May 16 15:24:59.615321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 247/495] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:24:59 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:24:59.869732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:24:59.869732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:24:59.869732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.869732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:24:59.870971 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:24:59.870971 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.028593 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:00.039438 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5443afce-7739-4577-a33e-cac02b43c2df tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.195868 May 16 15:25:00.040814 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 249/496] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:24:59 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:00.111813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:00.112424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:00.120191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.120581 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.121354 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.121782 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.260810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:00.268450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-673bee0e-a794-47b8-bb83-fa4e3d9c7e6a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.160823 May 16 15:25:00.269012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 248/497] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:00 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:00.364958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:00.365840 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:00.372870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.373696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.374763 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.375430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.523380 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:00.532169 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-25ccc12a-faa7-4dda-85d1-f3e1886b43cb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.170990 May 16 15:25:00.532748 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 250/498] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:00 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:00.635336 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:00.635988 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:00.642392 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.642850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.643645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:00.644090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:00.814455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:00.824648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:00.826582 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:00.828126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f3cce2c1-e280-497c-b0e8-425469dbcbe0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.197199 May 16 15:25:00.839569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 249/499] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:00 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:01.059311 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:01.059874 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:01.066481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.066933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.067713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.068151 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.223397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:01.234330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a6158e94-e940-46eb-a4ed-3fe505789512 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.179473 May 16 15:25:01.237923 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 251/500] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:01 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:01.286212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:01.286826 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:01.293759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.294232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.295015 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.295445 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.443211 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:01.451213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-41af1fa3-d1a4-4286-9e13-b82c3fcf3582 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.168676 May 16 15:25:01.457700 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 250/501] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:01 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:01.556636 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:01.557488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:01.569048 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.569667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.570566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.571165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.734440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:01.743263 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c5ab4ce8-dc28-42fa-b468-0077d6e365fd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.190879 May 16 15:25:01.744226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 252/502] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:01 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:01.849314 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:01.849847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:01.857933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.858635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:01.859422 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:01.859887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.016219 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:02.025850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:02.027613 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:02.028795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-27d06eb8-234a-4450-82bd-524c0b258867 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.185452 May 16 15:25:02.029352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 251/503] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:01 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:02.254972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:02.255570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:02.263299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.263744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.264518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.264955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.402224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:02.409508 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c287bafd-f79b-43f1-ac99-3cc7dd008633 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.158458 May 16 15:25:02.410068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 253/504] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:02 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:02.468704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:02.471352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:02.479671 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.480270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.481118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.481551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.638571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:02.645727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-066604d7-7403-4688-9b5a-3e33707c7f0d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.181125 May 16 15:25:02.646310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 252/505] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:02 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:02.759752 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:02.760351 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:02.766237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.766682 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.767462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:02.767888 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:02.912833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:02.920790 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a05e04af-4a3c-4053-8964-7a02fc8ee41c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.165410 May 16 15:25:02.921452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 254/506] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:02 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:03.048349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:03.049623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:03.060996 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.061796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.062833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.063561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.224805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:03.235892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:03.239883 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:03.241023 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cb93b195-d8a0-435f-a94a-6379fb3be1d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.197359 May 16 15:25:03.241584 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 253/507] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:03 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:03.427963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:03.429327 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:03.436755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.437476 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.438469 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.439234 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.598624 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:03.606766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dbc2aa9f-4887-4a44-9093-779ffa7158b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.182782 May 16 15:25:03.607428 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 255/508] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:03 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:03.661658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:03.662561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:03.671296 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.671845 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.672705 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.673213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.811704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:03.819448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7cdbaeea-c9b0-4887-8247-49922eacf7e1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.161711 May 16 15:25:03.829512 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 254/509] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:03 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:03.940373 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:03.940990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:03.948151 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.948608 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:03.949513 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:03.949953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.095994 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:04.105239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-71026f22-7e67-4af8-b667-008c0858641f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.168677 May 16 15:25:04.105829 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 256/510] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:03 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:04.264539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:04.265339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:04.271512 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.271960 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.272734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.273172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.421673 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:04.433385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:04.438684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:04.440057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0016dac0-5fe6-41bd-8469-4640c787ec2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.181788 May 16 15:25:04.441483 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 255/511] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:04 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:04.624956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:04.625574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:04.634321 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.634873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.635791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.636345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.809847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:04.821132 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-244cbd24-1b60-41a7-848b-713e93a9fe1f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.201200 May 16 15:25:04.822560 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 257/512] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:04 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:04.837113 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:04.837898 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:04.844744 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.845212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:04.846067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:04.846594 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.057915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:05.067145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f554d9c-0b63-4b1a-b123-ef119beca6ef tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.233987 May 16 15:25:05.078437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 256/513] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:04 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:05.123037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:05.123646 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:05.130430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.130917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.131760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.132227 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.289185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:05.300760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3885724a-76ed-4aed-a6a9-a730079c4339 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.182490 May 16 15:25:05.301547 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 258/514] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:05 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:05.494286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:05.494286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:05.494286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.494286 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.495383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.495383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.601292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:05.612252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:05.613857 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:05.615070 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c885d065-ab08-4f7b-9e31-89837458c0c6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.160300 May 16 15:25:05.615629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 257/515] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:05 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:05.845713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:05.846708 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:05.856161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.856790 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:05.857980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:05.858622 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.024737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:06.033767 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1f4ed92b-00bc-4f3e-b56a-5e3ca147750a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1676 microversion: 2.1 time: 0.197039 May 16 15:25:06.034512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 259/516] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:05 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:06.085284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:06.085897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:06.094524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:06.094524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.094524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:06.094874 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.265459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:06.273626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bb405ad7-057f-409e-86f1-b2b1e66b59fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.192706 May 16 15:25:06.274241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 258/517] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:06 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:06.319976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:06.320613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:06.330859 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:06.331310 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.332149 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:06.332528 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.468944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:06.477522 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07d3436c-60f3-49e8-91fa-fa8ec3c572e8 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.162808 May 16 15:25:06.478097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 260/518] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:06 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:06.632897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:06.633506 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:06.639569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:06.640017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.640772 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:06.641200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:06.774780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:06.783034 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:06.784634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:06.785888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e7e4b449-e188-4781-a64a-7730b2cae831 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.157026 May 16 15:25:06.786586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 259/519] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:06 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:07.050347 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:07.050956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:07.057447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.057887 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.058696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.059126 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.190105 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:07.197640 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fc1fb545-110d-466e-a547-15753fc59c7f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1653 microversion: 2.1 time: 0.151143 May 16 15:25:07.198222 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 261/520] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:07 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1653 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:07.215044 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a2a494df-c9fb-4f0d-9a73-eca46d368fff tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:07.221456 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2a494df-c9fb-4f0d-9a73-eca46d368fff tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.221903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a2a494df-c9fb-4f0d-9a73-eca46d368fff tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.243925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a2a494df-c9fb-4f0d-9a73-eca46d368fff tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Going to try to start instance {{(pid=117616) start /opt/stack/nova/nova/compute/api.py:2730}} May 16 15:25:07.291090 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:07.291693 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:07.297474 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.297915 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.298711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.299137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.384433 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a2a494df-c9fb-4f0d-9a73-eca46d368fff tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action" status: 202 len: 0 microversion: 2.1 time: 0.173620 May 16 15:25:07.385436 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 260/521] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:25:07 2022] POST /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:25:07.393925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:07.394730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:07.402316 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.402766 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.403557 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.403990 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.434635 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:07.442055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-467e06f9-9396-4168-9b37-a19a9ace6a7c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.155375 May 16 15:25:07.442661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 262/522] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:07 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:07.493971 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:07.494596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:07.500620 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.501059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.501821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.502275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.532769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:07.540240 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1f80867e-16eb-47dc-b0bf-76b3b7b487d1 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1662 microversion: 2.1 time: 0.150756 May 16 15:25:07.540809 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 261/523] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:07 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:07.643303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:07.647399 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f53b4dba-12a7-464e-9633-627d217c5265 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.157236 May 16 15:25:07.647967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 263/524] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:07 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:07.805132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:07.806236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:07.812184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.812629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:07.813532 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:07.814015 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:08.014951 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:08.025529 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:08.027150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:08.028355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-36af86e0-51fe-497a-992b-fe68dc953ae2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.227532 May 16 15:25:08.039051 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 262/525] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:07 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:08.459620 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:08.460386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:08.468075 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:08.469641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:08.469641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:08.469820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:08.557173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:08.557864 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:08.564634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:08.565087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:08.565875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:08.566341 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:08.629066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:08.636475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-74b008c7-bde5-48c0-97a6-8556ee5a56f2 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.180932 May 16 15:25:08.637038 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 264/526] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:08 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:08.664767 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:08.666090 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:08.672758 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:08.673244 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:08.674020 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:08.674484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:08.803517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:08.810932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ee9b772a-3697-4e80-a74e-9f06deb18c97 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.149956 May 16 15:25:08.811498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 265/527] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:08 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:08.858484 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:08.866411 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aad71010-b689-46fc-809f-02dda5b4a13a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1662 microversion: 2.1 time: 0.313416 May 16 15:25:08.866985 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 263/528] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:08 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1662 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:09.048687 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:09.049298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:09.055364 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.055807 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.059558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.059558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.192805 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:09.201886 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:09.203486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:09.204648 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5b2343c9-3329-4d50-9247-8e040a8c0adf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.160122 May 16 15:25:09.205200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 266/529] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:09 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:09.652815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:09.653361 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:09.659611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.661626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.661626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.661626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.785641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:09.793441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ce8e5638-02cc-4c27-afc5-76eb97cc0bb7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.144502 May 16 15:25:09.794003 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 264/530] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:09 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:09.827299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:09.827918 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:09.834352 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.834803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.835570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.836005 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.884453 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:09.885070 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:09.891099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.891552 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.892326 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:09.892765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:09.971075 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:09.981177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b2d062eb-fc20-4ef5-bbb3-b8664d5b2450 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.157549 May 16 15:25:09.981761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 267/531] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:09 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:10.025224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:10.032828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4cf6ff66-a73f-497b-a1b2-d8f610c5d49a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1662 microversion: 2.1 time: 0.152193 May 16 15:25:10.033467 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 265/532] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:09 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:10.223314 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:10.223929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:10.230349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:10.230803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:10.231579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:10.232014 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:10.367611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:10.381808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:10.383359 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:10.385117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b8a706e6-b22a-4d14-93fb-a9b4c1eeeab2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.165603 May 16 15:25:10.385678 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 268/533] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:10 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:10.809606 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:10.810246 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:10.816477 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:10.816935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:10.817699 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:10.818156 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:10.944586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:10.952377 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-77b2b69f-934a-4f3b-81aa-65177934e9fc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.147144 May 16 15:25:10.952935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 266/534] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:10 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:10.998700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:10.999303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:11.006050 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.006594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.007345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.007774 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.050463 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:11.051182 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:11.059303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.060819 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.063313 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.064940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.145948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:11.153498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6117afc9-1930-4a85-a578-f00a68c914cc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.159055 May 16 15:25:11.154071 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 269/535] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:10 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:11.200149 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:11.207571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b617900e-2e22-407d-abd5-61d70f5d0e91 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1662 microversion: 2.1 time: 0.160900 May 16 15:25:11.208137 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 267/536] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:11 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:11.403899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:11.404503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:11.410423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.410868 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.411619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.412046 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.539272 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:11.548032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:11.549557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:11.574396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8a6d875a-99a5-4207-bdc5-a98191cd594e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.151453 May 16 15:25:11.574396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 270/537] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:11 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:11.879583 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-cbfdac2e-b082-499e-abd7-ad7bc11cd4e0 req-cb50e5d9-d25f-4b36-baa4-fa0b135577c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e9b501-f7d9-4696-a6c2-c1930221431a", "name": "network-vif-plugged", "status": "completed", "tag": "63eb5f5f-0157-446b-b8eb-bc09b2fc4125"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:11.889791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-cbfdac2e-b082-499e-abd7-ad7bc11cd4e0 req-cb50e5d9-d25f-4b36-baa4-fa0b135577c8 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.890299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-cbfdac2e-b082-499e-abd7-ad7bc11cd4e0 req-cb50e5d9-d25f-4b36-baa4-fa0b135577c8 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.901672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-cbfdac2e-b082-499e-abd7-ad7bc11cd4e0 req-cb50e5d9-d25f-4b36-baa4-fa0b135577c8 service nova] Creating event network-vif-plugged:63eb5f5f-0157-446b-b8eb-bc09b2fc4125 for instance 26e9b501-f7d9-4696-a6c2-c1930221431a on hv-cinder-79053 May 16 15:25:11.906526 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-cbfdac2e-b082-499e-abd7-ad7bc11cd4e0 req-cb50e5d9-d25f-4b36-baa4-fa0b135577c8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031048 May 16 15:25:11.907122 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 268/538] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:11.968799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:11.969519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:11.975568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.976013 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:11.976987 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:11.977418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:12.118322 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:12.123562 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-116d29c9-2796-4793-b179-a6ed8d7f04ed tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.158595 May 16 15:25:12.124331 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 271/539] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:11 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:12.171007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:12.171818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:12.179198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:12.179716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:12.180618 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:12.181057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:12.224602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:12.225299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:12.232145 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:12.232649 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:12.233499 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:12.233962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:12.321696 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:12.330564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-05ad3b18-33a0-4ceb-af8f-28d346213a12 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.163316 May 16 15:25:12.330825 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 269/540] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:12 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:12.384631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:12.392292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e1c29a1a-c6a5-49b1-bdb7-08faae88e413 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1666 microversion: 2.1 time: 0.171519 May 16 15:25:12.392956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 272/541] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:12 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1666 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:12.568977 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:12.569650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:12.576549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:12.577003 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:12.577776 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:12.578426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:12.727055 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:12.735299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:12.736805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:12.737956 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c8bbcfe3-4f7f-43da-8ff1-d28432988d16 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.173036 May 16 15:25:12.738576 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 270/542] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:12 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:13.139421 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:13.140040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:13.146532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.146978 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.147742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.148174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.220546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e82996b1-1237-4e34-b2a1-b9e51a2da146 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c74d0c38-f410-46df-9356-8e48f65256c2", "device": "/dev/sdb"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:13.222362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e82996b1-1237-4e34-b2a1-b9e51a2da146 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:13.229354 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e82996b1-1237-4e34-b2a1-b9e51a2da146 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.229811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e82996b1-1237-4e34-b2a1-b9e51a2da146 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.230615 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e82996b1-1237-4e34-b2a1-b9e51a2da146 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.231092 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e82996b1-1237-4e34-b2a1-b9e51a2da146 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.277944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:13.285320 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-04fc49b2-a836-4b13-84c7-0a57a4cdce8e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.149798 May 16 15:25:13.285893 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 273/543] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:13 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:13.346873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:13.347506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:13.353254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.353692 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.355120 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.355549 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.484992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:13.492655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-084fc739-e29e-4c99-bc03-88d782fdfc70 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.149493 May 16 15:25:13.493217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 274/544] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:13 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:13.757088 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:13.757702 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:13.764390 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.764839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.765604 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.766039 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.896362 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:13.907619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:13.909109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:13.910364 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c22054d6-efac-4a02-93df-01e974e9048b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.157117 May 16 15:25:13.918031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 275/545] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:13 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:13.937338 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-d4cc1220-d493-4a6e-a37a-728272670738 req-6d199bb9-0d0f-46b4-afe0-bde0a907ba88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f5d91-18aa-47bd-a848-e09d19e8f6c4", "name": "network-vif-plugged", "status": "completed", "tag": "a3126c76-9ed9-4501-8584-9b5b2ba2d62e"}, {"server_uuid": "5887d24b-6885-49f4-99d0-7f99f99536cc", "name": "network-vif-plugged", "status": "completed", "tag": "7f2dac2d-8507-4083-81bf-4f66b2f74796"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:13.946768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d4cc1220-d493-4a6e-a37a-728272670738 req-6d199bb9-0d0f-46b4-afe0-bde0a907ba88 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:13.947212 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-d4cc1220-d493-4a6e-a37a-728272670738 req-6d199bb9-0d0f-46b4-afe0-bde0a907ba88 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:13.960175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-d4cc1220-d493-4a6e-a37a-728272670738 req-6d199bb9-0d0f-46b4-afe0-bde0a907ba88 service nova] Creating event network-vif-plugged:a3126c76-9ed9-4501-8584-9b5b2ba2d62e for instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 on hv-cinder-79053 May 16 15:25:13.960689 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-d4cc1220-d493-4a6e-a37a-728272670738 req-6d199bb9-0d0f-46b4-afe0-bde0a907ba88 service nova] Creating event network-vif-plugged:7f2dac2d-8507-4083-81bf-4f66b2f74796 for instance 5887d24b-6885-49f4-99d0-7f99f99536cc on hv-cinder-79053 May 16 15:25:13.967777 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-d4cc1220-d493-4a6e-a37a-728272670738 req-6d199bb9-0d0f-46b4-afe0-bde0a907ba88 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033896 May 16 15:25:13.968361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 276/546] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:14.309503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:14.310206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:14.316260 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:14.316730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:14.317506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:14.317938 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:14.446807 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:14.455287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-af541c60-8295-417f-92ba-31d0a22ea1a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.151135 May 16 15:25:14.456102 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 277/547] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:14 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:14.509634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:14.510431 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:14.516275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:14.516711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:14.517461 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:14.517886 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:14.568223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e82996b1-1237-4e34-b2a1-b9e51a2da146 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "POST /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.351270 May 16 15:25:14.573867 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 271/548] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:25:13 2022] POST /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc/os-volume_attachments => generated 194 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:14.659586 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:14.667029 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bd91a466-563b-46ef-bb11-3b42dbed7e05 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1258 microversion: 2.1 time: 0.161228 May 16 15:25:14.667593 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 278/549] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:14 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:14.928883 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:14.929574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:14.936673 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:14.937210 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:14.938040 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:14.938511 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:15.080294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:15.089163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:15.090748 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:15.091902 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b071d3c6-4697-4f24-bd9d-e4dc5023ef62 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.167350 May 16 15:25:15.092451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 272/550] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:14 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:15.471794 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:15.472531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:15.478676 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:15.479168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:15.479933 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:15.480388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:15.637721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:15.646755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-305590e4-e7f8-464f-8cec-64e60dcb3042 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.178678 May 16 15:25:15.657372 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 279/551] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:15 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:15.684401 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:15.685096 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:15.691383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:15.691870 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:15.693260 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:15.693715 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:15.830403 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:15.837781 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f9eb7608-1317-4f00-a626-b4324e5492e4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1442 microversion: 2.1 time: 0.157698 May 16 15:25:15.838380 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 273/552] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:15 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:15.853826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:15.854469 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:15.860371 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:15.860823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:15.861592 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:15.862035 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:15.989256 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:15.997699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-49651328-6cfd-4961-81d3-bc640682be3e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1442 microversion: 2.1 time: 0.147905 May 16 15:25:15.998300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 280/553] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:15 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1442 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:16.109661 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:16.110368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:16.116828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.117282 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.118054 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.118538 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.294357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:16.302541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:16.304072 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:16.305185 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-01f585f7-4008-4719-b7ff-614a90fa879a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.199454 May 16 15:25:16.305739 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 274/554] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:16 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:16.664828 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:16.665611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:16.674014 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.674757 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.675603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.676103 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.690893 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:16.692568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:16.699228 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.699944 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.700982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:16.701630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:16.728901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lazy-loading 'flavor' on Instance uuid d0316dc2-94eb-4a8c-811e-057cbe5fd20e {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:25:16.824413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:16.831879 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d63184ce-2a9a-4cb1-8b1b-819954cdd4c1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1358 microversion: 2.1 time: 0.171476 May 16 15:25:16.834619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 281/555] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:16 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:17.196560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8199967d-a2f3-4a0e-b6d4-355becfdee16 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/action" status: 200 len: 32 microversion: 2.1 time: 0.509963 May 16 15:25:17.197181 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 275/556] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:25:16 2022] POST /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:25:17.206738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:17.207407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:17.213195 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.213798 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.214605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.215047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.330691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:17.330691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:17.332762 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.333218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.333997 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.334457 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.362770 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:17.372141 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a9e3b07a-e2c2-4aaa-ace2-32385d89a55d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.169147 May 16 15:25:17.372943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 282/557] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:17 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:17.785349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:17.785349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:17.786145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:17.786145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e0bd74eb-6aed-4acc-aaa0-458994269930 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.464408 May 16 15:25:17.797269 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 276/558] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:17 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:25:17.849266 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:17.849846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:17.857078 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.857523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.858327 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:17.858758 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:17.990371 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:17.998097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-03bfe2a8-ac81-4e73-a9f8-49e3b5faccd6 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1548 microversion: 2.1 time: 0.152785 May 16 15:25:17.998775 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 283/559] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:17 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:18.014500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:18.015159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:18.021248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.021701 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.026663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.026663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.324563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:18.331887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cf57fbb0-a811-40e7-af72-7858fb561e20 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1548 microversion: 2.1 time: 0.321418 May 16 15:25:18.337067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 277/560] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:18 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1548 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:18.347886 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:18.351368 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:18.352187 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Searching by: {'deleted': False, 'project_id': '65e5f9f015814278b1062e2d7d681cc5'} {{(pid=117615) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 16 15:25:18.367717 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.368245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.369120 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.369557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.395179 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:18.396206 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:18.405628 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.406187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.407188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.407826 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.472967 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.multi_cell_list [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117615) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 16 15:25:18.575741 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-305e8094-1783-4026-b242-77bce99b642f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229192 May 16 15:25:18.575741 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 284/561] 10.222.0.76 () {58 vars in 1124 bytes} [Mon May 16 15:25:18 2022] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:18.587219 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:18.587896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:18.594424 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.594875 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.595636 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.596070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.611562 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:18.622309 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-64ec7253-de7e-4fb5-9fb6-fef08e20850a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.235647 May 16 15:25:18.623533 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 278/562] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:18 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:18.761451 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:18.771354 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f676e8ff-86f1-4ed4-9e12-4aa257c46a54 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1548 microversion: 2.1 time: 0.187937 May 16 15:25:18.772594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 285/563] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:18 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:18.805469 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:18.806259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:18.814384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.814956 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:18.815824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:18.816360 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.150079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-fc28f50b-ff6a-4de8-bf59-5654ea41d22c req-f30d1729-8deb-4264-9316-4d90e9aad1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e9b501-f7d9-4696-a6c2-c1930221431a", "tag": "63eb5f5f-0157-446b-b8eb-bc09b2fc4125"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:19.160771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-fc28f50b-ff6a-4de8-bf59-5654ea41d22c req-f30d1729-8deb-4264-9316-4d90e9aad1a5 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.162279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-fc28f50b-ff6a-4de8-bf59-5654ea41d22c req-f30d1729-8deb-4264-9316-4d90e9aad1a5 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.169978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.180684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.181430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-fc28f50b-ff6a-4de8-bf59-5654ea41d22c req-f30d1729-8deb-4264-9316-4d90e9aad1a5 service nova] Creating event network-changed:63eb5f5f-0157-446b-b8eb-bc09b2fc4125 for instance 26e9b501-f7d9-4696-a6c2-c1930221431a on hv-cinder-79053 May 16 15:25:19.182343 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.184252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1d50119c-b417-4714-97ac-ead59da6e43f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1809 microversion: 2.20 time: 0.383101 May 16 15:25:19.184890 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 279/564] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:18 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1809 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:19.195084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-fc28f50b-ff6a-4de8-bf59-5654ea41d22c req-f30d1729-8deb-4264-9316-4d90e9aad1a5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042599 May 16 15:25:19.195084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 286/565] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:19.639492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:19.640130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:19.646792 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.647469 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.648457 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:19.649641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:19.822206 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:19.831186 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e586f272-dee3-4ba1-8a11-911f29063375 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.195466 May 16 15:25:19.831782 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 280/566] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:19 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:20.203877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:20.204574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:20.211702 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.212145 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.212914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.213345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.342969 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:20.351214 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:20.352789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:20.353952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-899ee54d-c81c-4be6-9fc9-039bbe4f8ef0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1796 microversion: 2.20 time: 0.154345 May 16 15:25:20.354577 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 287/567] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:25:20 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1796 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:25:20.849474 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:20.850411 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:20.857200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.857659 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.858463 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.858910 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.900586 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e226d9fb-983f-48f0-af84-c9f2223acbe3 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c64a1af1-98a3-48e9-b5f4-17e433c98d21"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:20.901703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e226d9fb-983f-48f0-af84-c9f2223acbe3 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:20.907612 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e226d9fb-983f-48f0-af84-c9f2223acbe3 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.908071 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e226d9fb-983f-48f0-af84-c9f2223acbe3 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.908842 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e226d9fb-983f-48f0-af84-c9f2223acbe3 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:20.909278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e226d9fb-983f-48f0-af84-c9f2223acbe3 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:20.990550 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:20.999334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2c294e48-1330-4012-89ec-5ef6d2f1a562 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.153853 May 16 15:25:21.009394 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 281/568] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:20 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:21.642567 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e226d9fb-983f-48f0-af84-c9f2223acbe3 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745623 May 16 15:25:21.643179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 288/569] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:25:20 2022] POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:25:22.016609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:22.017150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:22.023586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:22.024042 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:22.024995 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:22.025241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:22.153886 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:22.161559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-945d35c5-d766-41c3-938c-b5c8e17ff2bc tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.148903 May 16 15:25:22.162140 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 282/570] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:22 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:23.179680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:23.180376 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:23.187108 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:23.187558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:23.188321 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:23.188753 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:23.311916 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:23.319682 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-599b95c9-a045-418a-b965-a6ab4a56946c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.144619 May 16 15:25:23.320248 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 289/571] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:23 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:24.337530 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:24.338167 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:24.344967 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:24.345422 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:24.346215 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:24.346653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:24.473198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:24.481163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-90718ab1-7ed3-4741-bc17-82dc76af1b32 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.147570 May 16 15:25:24.481729 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 283/572] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:24 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:25.498278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:25.498803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:25.505141 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:25.505590 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:25.506397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:25.506828 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:25.632715 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:25.640638 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a4c82f80-0284-49d1-9115-72baf5b2f1e6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.146576 May 16 15:25:25.641222 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 290/573] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:25 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:26.661069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:26.661681 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:26.668066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:26.669010 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:26.669789 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:26.670327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:26.797449 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:26.805243 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9c80331a-4b22-4b8f-87a2-715932871a1b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.149643 May 16 15:25:26.805812 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 284/574] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:26 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:27.823591 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:27.824130 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:27.830512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.830961 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:27.831714 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:27.832141 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:27.960472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:27.968725 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e4553034-4900-4cab-a5d7-edff38b34e5e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.149167 May 16 15:25:27.969307 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 291/575] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:27 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:28.985804 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:28.986618 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:28.992822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:28.993274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:28.994038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:28.994504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:29.124032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:29.131697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-268d5d0e-d430-480a-a655-4f702c46ff0f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.150255 May 16 15:25:29.132255 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 285/576] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:28 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:30.148728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:30.149331 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:30.156195 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.156638 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.158067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:30.158067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:30.283720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:30.291498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f05bd848-ba74-4dc9-b944-ae1fc097c841 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.146561 May 16 15:25:30.292061 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 292/577] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:30 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:31.308466 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:31.309089 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:31.316274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.316730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.317533 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:31.317974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:31.443157 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:31.451560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cf7b7b4e-b0cc-44d2-bf10-c4fc8c3ae07a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.146366 May 16 15:25:31.452122 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 286/578] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:31 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:32.469115 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:32.469635 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:32.476047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.476501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.477278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:32.477713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:32.607420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:32.615169 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fd7f85ba-72d1-4074-b7c5-43d6ff23b7ac tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.150616 May 16 15:25:32.615724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 293/579] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:32 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:33.632151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:33.632769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:33.639094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.639546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.640316 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:33.640764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:33.765416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:33.774849 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f82d9ffa-466d-49bd-b85e-13b719ee7129 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.146575 May 16 15:25:33.775432 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 287/580] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:33 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:34.792108 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:34.792731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:34.799038 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.799482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.800249 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:34.800684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:34.931956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:34.940469 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7acbe9a0-8076-41ac-8158-515b342cd928 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.152231 May 16 15:25:34.941039 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 294/581] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:34 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:35.523009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:35.523628 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:35.530067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.530554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.531325 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.531765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.660153 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:35.667873 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-12615777-7c04-4842-9720-52399b594b74 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1594 microversion: 2.1 time: 0.148784 May 16 15:25:35.668429 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 288/582] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:35 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1594 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:35.961449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:35.962082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:35.968329 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.968771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:35.969523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:35.969947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:36.099144 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:36.107087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6c0ae06f-885b-482b-a6db-5b80f51ea91c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.149494 May 16 15:25:36.107983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 295/583] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:35 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:37.128144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:37.128713 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:37.135103 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.135634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.136511 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:37.137024 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:37.617217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:37.625306 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-756c3864-056f-4acb-b5c4-c63f749a84a5 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.502489 May 16 15:25:37.626191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 289/584] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:37 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:38.018106 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-14104ffc-06c8-437a-8b44-709328799858 req-88a155da-815a-42c9-98c3-c7ff921961f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5887d24b-6885-49f4-99d0-7f99f99536cc", "tag": "7f2dac2d-8507-4083-81bf-4f66b2f74796"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:38.026954 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-14104ffc-06c8-437a-8b44-709328799858 req-88a155da-815a-42c9-98c3-c7ff921961f5 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:38.027450 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-14104ffc-06c8-437a-8b44-709328799858 req-88a155da-815a-42c9-98c3-c7ff921961f5 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:38.039667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-14104ffc-06c8-437a-8b44-709328799858 req-88a155da-815a-42c9-98c3-c7ff921961f5 service nova] Creating event network-changed:7f2dac2d-8507-4083-81bf-4f66b2f74796 for instance 5887d24b-6885-49f4-99d0-7f99f99536cc on hv-cinder-79053 May 16 15:25:38.044855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-14104ffc-06c8-437a-8b44-709328799858 req-88a155da-815a-42c9-98c3-c7ff921961f5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031391 May 16 15:25:38.045530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 296/585] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:38.645188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:38.645822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:38.652609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:38.653921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:38.654877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:38.655318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:38.853718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:38.862589 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3b0c2f4e-fd17-4987-8f82-e9c40c01e644 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.223106 May 16 15:25:38.864406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 290/586] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:38 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:39.882390 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:39.883640 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:39.890251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.890782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:39.891467 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:39.891898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.039479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:40.047254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c9b909db-e127-4045-a78d-693454d09257 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.170129 May 16 15:25:40.048458 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 297/587] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:39 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:40.689545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1440232428"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:40.690081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:40.696402 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.696858 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.697626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:40.698058 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:40.823435 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.network.security_group_api [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Adding security group 086037b6-0729-4e22-b718-40f3c5f17796 to port 7f2dac2d-8507-4083-81bf-4f66b2f74796 May 16 15:25:41.063936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:41.064960 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:41.071188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:41.071639 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.072400 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:41.072831 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.199897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:41.207690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5b4b5d0b-c9da-4c77-a758-a9d31cfb16c8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.147672 May 16 15:25:41.208258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 298/588] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:41 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:41.267112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f020745a-9723-4fb9-b7a2-9d6dc11f3988 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/action" status: 202 len: 0 microversion: 2.1 time: 0.581468 May 16 15:25:41.268709 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 291/589] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:25:40 2022] POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:25:41.277535 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:41.281920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:41.287018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-20f52ed6-e658-4836-860a-7e8f319c19dd req-44ea6229-c104-4b11-a8f0-bf3707c9d69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5887d24b-6885-49f4-99d0-7f99f99536cc", "tag": "7f2dac2d-8507-4083-81bf-4f66b2f74796"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:41.295125 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:41.301102 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.306560 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:41.307011 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.313081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-20f52ed6-e658-4836-860a-7e8f319c19dd req-44ea6229-c104-4b11-a8f0-bf3707c9d69f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:41.313533 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-20f52ed6-e658-4836-860a-7e8f319c19dd req-44ea6229-c104-4b11-a8f0-bf3707c9d69f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:41.325173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-20f52ed6-e658-4836-860a-7e8f319c19dd req-44ea6229-c104-4b11-a8f0-bf3707c9d69f service nova] Creating event network-changed:7f2dac2d-8507-4083-81bf-4f66b2f74796 for instance 5887d24b-6885-49f4-99d0-7f99f99536cc on hv-cinder-79053 May 16 15:25:41.335504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-20f52ed6-e658-4836-860a-7e8f319c19dd req-44ea6229-c104-4b11-a8f0-bf3707c9d69f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056413 May 16 15:25:41.336410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 292/590] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:41.477237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:41.490501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0e67e5b7-5c39-4ace-896a-b46fed8223dc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1760 microversion: 2.1 time: 0.217763 May 16 15:25:41.491809 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 299/591] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:41 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1760 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:42.228383 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:42.229078 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:42.235198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.235652 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.236421 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.236865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.362566 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:42.370312 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-eb5c7e7f-3974-4fe3-b781-c2c93c2347c3 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.146575 May 16 15:25:42.370875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 293/592] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:42 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:42.665982 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:42.666531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:42.672813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.673281 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.674086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:42.674578 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:42.753011 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lazy-loading 'services' on Instance uuid 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:25:42.959017 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6c1e80c8-c39a-4934-94a3-623801ac1306 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc/os-volume_attachments/c74d0c38-f410-46df-9356-8e48f65256c2" status: 202 len: 0 microversion: 2.1 time: 0.296755 May 16 15:25:42.959642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 300/593] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:25:42 2022] DELETE /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc/os-volume_attachments/c74d0c38-f410-46df-9356-8e48f65256c2 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:25:43.387391 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:43.388006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:43.394294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.394752 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.395524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:43.395965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:43.522742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:43.530509 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fe4512d3-b805-4e70-b42a-d856346d1525 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.147009 May 16 15:25:43.531075 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 294/594] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:43 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:44.548887 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:44.549490 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:44.556219 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:44.556667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:44.557418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:44.557842 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:44.687359 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:44.695594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-383aa70c-ad53-4de5-9d2e-6dce3ef86dce tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.151419 May 16 15:25:44.696150 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 301/595] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:44 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:45.119385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:45.119894 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:45.126500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.126958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.127738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.128176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.154860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:25:45.523679 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-226b41b5-5579-4c15-8cee-243392e44744 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 204 len: 0 microversion: 2.1 time: 0.407746 May 16 15:25:45.524295 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 295/596] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:25:45 2022] DELETE /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:25:45.533623 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:45.534786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:45.543983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.544442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.545224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.545663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.681690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:45.689092 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-969839da-d050-4704-a012-2695df025a04 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1513 microversion: 2.1 time: 0.160522 May 16 15:25:45.689668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 302/597] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:45 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:45.713357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:45.714057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:45.720086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.720537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.721304 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:45.721742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:45.849294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:45.857049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3c2787d0-185f-4406-9981-2fa23e9e85de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.147878 May 16 15:25:45.857610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 296/598] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:45 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:46.706700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:46.707805 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:46.714193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:46.714649 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:46.715421 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:46.715859 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:46.838073 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:46.846016 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7e4b3575-d482-47e5-8302-e4421d78f0fa tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1513 microversion: 2.1 time: 0.143128 May 16 15:25:46.846650 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 303/599] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:46 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:46.875259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:46.875869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:46.882392 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:46.882838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:46.883592 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:46.884022 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:47.009187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:47.017037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2c9850a5-e0ba-4498-8340-8b3a3c0145de tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.145971 May 16 15:25:47.017605 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 297/600] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:46 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:47.862803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:47.864042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:47.870418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:47.870892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:47.871661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:47.872115 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:48.016412 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:48.023681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-72aa20ed-49e7-485f-a6d8-6215787df54c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1513 microversion: 2.1 time: 0.164785 May 16 15:25:48.024251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 304/601] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:47 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:48.034610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:48.035743 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:48.042081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:48.042563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:48.043324 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:48.043758 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:48.179741 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:48.187622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6e2eb242-8152-425f-a6d7-675f1ef57a03 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.156814 May 16 15:25:48.188413 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 298/602] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:48 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:49.040288 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:49.040956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:49.047263 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:49.047704 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:49.048452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:49.048876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:49.171888 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:49.179022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-aa1b2999-7b51-4a22-a006-735b9e74d8ab tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1513 microversion: 2.1 time: 0.143191 May 16 15:25:49.179596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 305/603] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:49 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:49.204999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:49.205756 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:49.212721 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:49.213252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:49.214239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:49.214755 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:49.427635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:49.436053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8fef7307-76dd-4bfd-b5a9-5c0651af2730 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1734 microversion: 2.1 time: 0.234958 May 16 15:25:49.446239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 299/604] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:49 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:49.758062 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-03c55069-f8cc-4947-b5bb-279d170b0255 req-a8722db9-a753-4432-bd2c-0088616f74e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc", "name": "network-vif-deleted", "tag": "c7745a72-d5fd-48e6-8037-08c5e91923d2"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:49.765981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-03c55069-f8cc-4947-b5bb-279d170b0255 req-a8722db9-a753-4432-bd2c-0088616f74e3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:49.766456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-03c55069-f8cc-4947-b5bb-279d170b0255 req-a8722db9-a753-4432-bd2c-0088616f74e3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:49.777392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-03c55069-f8cc-4947-b5bb-279d170b0255 req-a8722db9-a753-4432-bd2c-0088616f74e3 service nova] Creating event network-vif-deleted:c7745a72-d5fd-48e6-8037-08c5e91923d2 for instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc on hv-cinder-79053 May 16 15:25:49.782268 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-03c55069-f8cc-4947-b5bb-279d170b0255 req-a8722db9-a753-4432-bd2c-0088616f74e3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027951 May 16 15:25:49.782839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 306/605] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:50.196856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:50.197513 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:50.203398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.203865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.204679 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.205121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.267374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:50.274974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-634d4125-c8de-4f25-9409-f71ffb938456 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 200 len: 1471 microversion: 2.1 time: 0.082774 May 16 15:25:50.275779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 300/606] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:50 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:50.453483 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:50.454091 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:50.461198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.461680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.462467 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.462901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.591629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:50.599844 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d4ba6771-57f4-431d-955a-a36088b941cd tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1714 microversion: 2.1 time: 0.150229 May 16 15:25:50.600397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 307/607] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:50 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:25:50.698866 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:50.699364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:50.705308 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.705703 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.706518 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.706963 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.829164 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] HTTP exception thrown: Cannot 'detach_volume' instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e while it is in vm_state rescued May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Request method failure captured: May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments/0906d85b-9ce3-4953-a020-47169db7ed4d HTTP/1.1 May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmv7qQTE8tLG33ej85dpt73LbP7nYUSJFQ4d_TW8DLi35Kx1Qbez_5294G-bCVt3blhIw7HkMV9SgEmA95NLP9nihR4FJu9fM_RWvQ39NM9g_RsA_tCDanLg4bewbec122zNONg-LfnoskEuA5-IgViyeb7Q7n588qsHtvtbhUPVAUM May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:25:50.831374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c3c3d75e638a4871b548ba689eeddeda", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 6c6b9438bb4245b3908664bfece4ef22 May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:25:50.832871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Cannot 'detach_volume' instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e while it is in vm_state rescued May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'server_id': 'd0316dc2-94eb-4a8c-811e-057cbe5fd20e', 'id': '0906d85b-9ce3-4953-a020-47169db7ed4d'} May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e in vm_state rescued. Cannot detach_volume while the instance is in this state. May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:25:50.834194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e while it is in vm_state rescued May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e while it is in vm_state rescued May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:25:50.835473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Returning 409 to user: Cannot 'detach_volume' instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e while it is in vm_state rescued {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:25:50.836454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-445dbc1c-be59-4e7d-aee5-53c86b1fd76a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments/0906d85b-9ce3-4953-a020-47169db7ed4d" status: 409 len: 152 microversion: 2.1 time: 0.137375 May 16 15:25:50.836454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 301/608] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:25:50 2022] DELETE /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments/0906d85b-9ce3-4953-a020-47169db7ed4d => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 16 15:25:50.841784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1b5c8e7b-e493-4ebc-8d34-f88cfadd6dd2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:50.842378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1b5c8e7b-e493-4ebc-8d34-f88cfadd6dd2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:50.848820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7b-e493-4ebc-8d34-f88cfadd6dd2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.849347 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7b-e493-4ebc-8d34-f88cfadd6dd2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:50.850104 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7b-e493-4ebc-8d34-f88cfadd6dd2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:50.850557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7b-e493-4ebc-8d34-f88cfadd6dd2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:51.110397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1b5c8e7b-e493-4ebc-8d34-f88cfadd6dd2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "POST /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/action" status: 202 len: 0 microversion: 2.1 time: 0.272122 May 16 15:25:51.114193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 308/609] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:25:50 2022] POST /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:25:51.120007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:51.120730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:51.128152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:51.128704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:51.129599 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:51.130114 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:51.291802 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:51.292413 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:51.292863 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:51.298815 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:51.299253 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:51.300019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:51.300441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:51.301187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4f35114b-f1ea-47c8-8384-4de2bad01aaa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1722 microversion: 2.1 time: 0.184386 May 16 15:25:51.301187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 302/610] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:51 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:51.314560 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] HTTP exception thrown: Instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc could not be found. May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Request method failure captured: May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc HTTP/1.1 May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmyuF0Sf5aowpUZZddY0FCxQd9iXhUY6PGSMNTyV0AbNAcZgDE19a6F9WtHLdDTytgfEdOs8xx-vLyDY1SgvNhaIK29iuBnPXX5qdZuE7eNa-P7hW-rhebgni74c_9aD_OvMbrkmBcwF_HvnoI_iobNaEKbysiYuAEd4ZoERNZDKxTQ May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 66e1e9277cbb4651901cbb84564ef9bd May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotTestJSON-64347822 May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:25:51.316259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/66e1e9277cbb4651901cbb84564ef9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_66e1e9277cbb4651901cbb84564ef9bd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/66e1e9277cbb4651901cbb84564ef9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/66e1e9277cbb4651901cbb84564ef9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotTestJSON-64347822 May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 66e1e9277cbb4651901cbb84564ef9bd May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-64347822 May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotTestJSON-64347822-project May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 0f4f36f69496486ab361b2c308826430 May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotTestJSON-64347822-project May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc could not be found. May 16 15:25:51.317813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc'} May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc could not be found. May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:25:51.320503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc could not be found. May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc could not be found. May 16 15:25:51.321825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:25:51.322982 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Returning 404 to user: Instance 0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:25:51.322982 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d64b05d7-7f11-4ac4-b946-e924b820d2f3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc" status: 404 len: 111 microversion: 2.1 time: 0.030017 May 16 15:25:51.322982 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 309/611] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:51 2022] GET /compute/v2.1/servers/0ea0ed7a-c7be-413b-bfa0-9c44bf7da2bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:25:52.319950 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:52.320568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:52.335348 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:52.335803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:52.336579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:52.337015 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:52.460853 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:52.468610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-88164a64-16e2-4d21-986e-72880653ae8e tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1722 microversion: 2.1 time: 0.153656 May 16 15:25:52.469180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 303/612] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:52 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:53.491241 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:53.491853 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:53.498208 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:53.498652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:53.499656 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:53.500082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:53.625555 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:53.633725 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e4a88e6c-99f8-42b1-92e9-29d61d048e78 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1722 microversion: 2.1 time: 0.146766 May 16 15:25:53.634303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 310/613] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:53 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:54.651115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:54.651761 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:54.658234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:54.658695 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:54.659464 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:54.659903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:54.788981 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:54.796762 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-14ca99e6-c5f6-4ce9-b967-83e15b0ea1a4 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1722 microversion: 2.1 time: 0.149432 May 16 15:25:54.797315 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 304/614] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:54 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:55.814082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:55.820872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:55.821615 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:55.822066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:55.822858 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:55.823293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:55.951975 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:55.960135 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-72ae2661-51e1-42e0-a692-0ec8825c02fa tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1722 microversion: 2.1 time: 0.149881 May 16 15:25:55.960900 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 311/615] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:55 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:56.981247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:56.982274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:56.989102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:56.989559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:56.990387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:56.991338 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:57.118366 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:57.126641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-25ea182e-cedb-4ad5-ab25-bc107b11082f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1722 microversion: 2.1 time: 0.150610 May 16 15:25:57.127235 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 305/616] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:56 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:58.143820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:58.144443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:58.151367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:58.151819 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:58.152583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:58.153019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:58.279774 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:25:58.287589 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-49113ab5-fd92-4a9d-9658-f45c8d69ed0c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1728 microversion: 2.1 time: 0.147614 May 16 15:25:58.288185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 312/617] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:25:58 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:25:58.304006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2a9d4fb0-b3f4-4017-9624-15f7881b08a6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:25:58.304502 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2a9d4fb0-b3f4-4017-9624-15f7881b08a6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:25:58.310838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a9d4fb0-b3f4-4017-9624-15f7881b08a6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:58.311293 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a9d4fb0-b3f4-4017-9624-15f7881b08a6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:58.312090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a9d4fb0-b3f4-4017-9624-15f7881b08a6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:58.312534 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2a9d4fb0-b3f4-4017-9624-15f7881b08a6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:58.389197 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2a9d4fb0-b3f4-4017-9624-15f7881b08a6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089041 May 16 15:25:58.389793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 306/618] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:25:58 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:25:59.520043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-7fdfc2cc-f8ae-4a2c-9dbc-765c9626ef28 req-16496174-2552-4091-816e-3c5537836cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0316dc2-94eb-4a8c-811e-057cbe5fd20e", "tag": "5932ef72-da59-4163-b091-83604c0d8211"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:25:59.531829 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7fdfc2cc-f8ae-4a2c-9dbc-765c9626ef28 req-16496174-2552-4091-816e-3c5537836cb0 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:25:59.532273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-7fdfc2cc-f8ae-4a2c-9dbc-765c9626ef28 req-16496174-2552-4091-816e-3c5537836cb0 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:25:59.544238 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-7fdfc2cc-f8ae-4a2c-9dbc-765c9626ef28 req-16496174-2552-4091-816e-3c5537836cb0 service nova] Creating event network-changed:5932ef72-da59-4163-b091-83604c0d8211 for instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e on hv-cinder-79053 May 16 15:25:59.549491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-7fdfc2cc-f8ae-4a2c-9dbc-765c9626ef28 req-16496174-2552-4091-816e-3c5537836cb0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034857 May 16 15:25:59.550246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 313/619] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:01.564485 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-8daacbfe-585d-4672-bb5b-4972a409b5b5 req-7184f4e6-954c-4e2a-9e82-ca1fa91cb0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0316dc2-94eb-4a8c-811e-057cbe5fd20e", "tag": "5932ef72-da59-4163-b091-83604c0d8211"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:01.573236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8daacbfe-585d-4672-bb5b-4972a409b5b5 req-7184f4e6-954c-4e2a-9e82-ca1fa91cb0c7 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:01.573682 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8daacbfe-585d-4672-bb5b-4972a409b5b5 req-7184f4e6-954c-4e2a-9e82-ca1fa91cb0c7 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:01.584552 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-8daacbfe-585d-4672-bb5b-4972a409b5b5 req-7184f4e6-954c-4e2a-9e82-ca1fa91cb0c7 service nova] Creating event network-changed:5932ef72-da59-4163-b091-83604c0d8211 for instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e on hv-cinder-79053 May 16 15:26:01.593112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-8daacbfe-585d-4672-bb5b-4972a409b5b5 req-7184f4e6-954c-4e2a-9e82-ca1fa91cb0c7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031633 May 16 15:26:01.593710 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 307/620] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:01.848411 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1918729009", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "networks": [{"uuid": "b080d6fb-6f80-4230-8970-1240bdaa9a98"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:01.898095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] validate_networks() for [('b080d6fb-6f80-4230-8970-1240bdaa9a98', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:26:02.229146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:26:02.229566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:26:02.230043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:26:02.230538 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:26:02.230948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:26:02.239423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:02.239869 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:02.240665 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:02.241095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:02.257792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Getting quotas for project 66e1e9277cbb4651901cbb84564ef9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:26:02.262356 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Getting quotas for user 0f4f36f69496486ab361b2c308826430 and project 66e1e9277cbb4651901cbb84564ef9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:26:02.273165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:26:02.275425 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:26:02.410792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f78521d5-2490-4685-827b-20483a6a1c83 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567014 May 16 15:26:02.411414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 314/621] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:26:02.422071 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-57a70cad-7ea8-4ebe-8ea5-60fd5732308b tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:02.422860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-57a70cad-7ea8-4ebe-8ea5-60fd5732308b tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:02.477614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57a70cad-7ea8-4ebe-8ea5-60fd5732308b tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:02.485032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-57a70cad-7ea8-4ebe-8ea5-60fd5732308b tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1219 microversion: 2.1 time: 0.067285 May 16 15:26:02.485601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 308/622] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:02 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:03.502766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:03.503388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:03.510702 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:03.511153 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:03.511927 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:03.512361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:03.574367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:03.581597 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5d134d25-d143-44e9-96bf-9673be421cda tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1223 microversion: 2.1 time: 0.083553 May 16 15:26:03.582356 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 315/623] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:03 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:04.598438 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:04.602545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:04.606087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:04.606563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:04.607326 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:04.607775 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:04.714625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:04.724635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4f3ed139-efb8-4dc1-8315-6c7670f4ae60 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1289 microversion: 2.1 time: 0.130092 May 16 15:26:04.725395 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 309/624] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:04 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1289 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:05.742398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:05.743254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:05.749868 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:05.751284 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:05.752249 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:05.752757 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:05.879589 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:05.887527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1b528ff-28af-4e7d-850f-807e8daf050c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.149161 May 16 15:26:05.888112 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 316/625] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:05 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:06.029278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-d9086654-519b-49e7-b77c-e99399325714 req-acf1a87b-4d69-4d79-865f-bd026c49cada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b642832-eb11-4777-a0ff-6cefeec8561f", "tag": "f7a7d96f-fc1c-4598-82d5-2f86bde61ae9"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:06.037786 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d9086654-519b-49e7-b77c-e99399325714 req-acf1a87b-4d69-4d79-865f-bd026c49cada service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:06.038261 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-d9086654-519b-49e7-b77c-e99399325714 req-acf1a87b-4d69-4d79-865f-bd026c49cada service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:06.049379 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-d9086654-519b-49e7-b77c-e99399325714 req-acf1a87b-4d69-4d79-865f-bd026c49cada service nova] Creating event network-changed:f7a7d96f-fc1c-4598-82d5-2f86bde61ae9 for instance 2b642832-eb11-4777-a0ff-6cefeec8561f on hv-cinder-79053 May 16 15:26:06.054032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-d9086654-519b-49e7-b77c-e99399325714 req-acf1a87b-4d69-4d79-865f-bd026c49cada service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028991 May 16 15:26:06.056041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 310/626] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:06.904559 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:06.905204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:06.911655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:06.912103 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:06.912867 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:06.913300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:07.035629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:07.043370 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26b93a2b-6ece-4dec-b21e-f9ba9797f4c6 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.142692 May 16 15:26:07.043936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 317/627] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:06 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:08.060817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:08.061521 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:08.067590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.068049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.068821 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.069267 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.100803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a7018cf-dd6c-4a0d-ab42-3a296c5b3949 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:08.101770 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3a7018cf-dd6c-4a0d-ab42-3a296c5b3949 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:08.108037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a7018cf-dd6c-4a0d-ab42-3a296c5b3949 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.108482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a7018cf-dd6c-4a0d-ab42-3a296c5b3949 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.109247 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a7018cf-dd6c-4a0d-ab42-3a296c5b3949 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.109676 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a7018cf-dd6c-4a0d-ab42-3a296c5b3949 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.138478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3a7018cf-dd6c-4a0d-ab42-3a296c5b3949 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041451 May 16 15:26:08.139037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 318/628] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:26:08 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:26:08.195422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:08.196133 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:08.198114 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:08.202531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.202973 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.203738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.204177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.206074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9e934952-79b9-48f2-a73e-d6291b20c2ce tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.149915 May 16 15:26:08.206677 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 311/629] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:08 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:08.227793 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:26:08.489926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f14d4cfb-9122-4da0-bc5f-69c6d7c451b7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 204 len: 0 microversion: 2.1 time: 0.297801 May 16 15:26:08.490563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 319/630] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:26:08 2022] DELETE /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:26:08.499520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:08.506611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:08.506611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.506854 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.507524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:08.507953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:08.635715 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:08.643519 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f314fbcb-561e-426b-9dc4-2102e870e70c tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1672 microversion: 2.1 time: 0.148678 May 16 15:26:08.644108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 312/631] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:08 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:09.223493 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:09.224187 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:09.231291 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:09.231884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:09.232669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:09.233102 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:09.357717 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:09.365053 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b25c6db4-951d-443a-9812-40e76aa6b0d8 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.145792 May 16 15:26:09.365616 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 320/632] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:09 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:09.661233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:09.661856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:09.668183 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:09.668639 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:09.669410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:09.669850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:09.797423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:09.804730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-39555653-e822-46e4-aee9-eeae78de4f35 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1672 microversion: 2.1 time: 0.147376 May 16 15:26:09.805297 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 313/633] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:09 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:10.382848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:10.383481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:10.390342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:10.390793 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:10.391554 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:10.391988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:10.521094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:10.528809 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2cebdf4e-ab1e-4361-a79f-9090b6ba683e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.150129 May 16 15:26:10.529369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 321/634] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:10 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:10.822523 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:10.823069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:10.830005 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:10.830489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:10.831263 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:10.831706 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:11.003342 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:11.010711 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bc8b0e24-66ce-49bb-91e2-b04cbc9a8831 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1672 microversion: 2.1 time: 0.192082 May 16 15:26:11.011865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 314/635] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:10 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:11.544766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:11.545375 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:11.551737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:11.552181 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:11.552948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:11.553378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:11.734894 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:11.742148 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f03c8c4c-25ce-4c12-a0c2-a1482d24e0a5 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.201262 May 16 15:26:11.742714 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 322/636] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:11 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:12.005400 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-8e440c00-0054-4797-ba3a-c48086ea181c req-af8ea98b-da4b-4e8d-abd8-dd4313ef88d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b642832-eb11-4777-a0ff-6cefeec8561f", "name": "network-vif-plugged", "status": "completed", "tag": "f7a7d96f-fc1c-4598-82d5-2f86bde61ae9"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:12.013958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8e440c00-0054-4797-ba3a-c48086ea181c req-af8ea98b-da4b-4e8d-abd8-dd4313ef88d7 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.014442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-8e440c00-0054-4797-ba3a-c48086ea181c req-af8ea98b-da4b-4e8d-abd8-dd4313ef88d7 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.028395 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-8e440c00-0054-4797-ba3a-c48086ea181c req-af8ea98b-da4b-4e8d-abd8-dd4313ef88d7 service nova] Creating event network-vif-plugged:f7a7d96f-fc1c-4598-82d5-2f86bde61ae9 for instance 2b642832-eb11-4777-a0ff-6cefeec8561f on hv-cinder-79053 May 16 15:26:12.028997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:12.029716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:12.033554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-8e440c00-0054-4797-ba3a-c48086ea181c req-af8ea98b-da4b-4e8d-abd8-dd4313ef88d7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032477 May 16 15:26:12.034423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 315/637] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:12.035724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.036157 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.036951 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.037361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.046156 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f972563b-d1b2-4f4f-9244-b93755a4f298 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:12.046971 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f972563b-d1b2-4f4f-9244-b93755a4f298 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:12.054326 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f972563b-d1b2-4f4f-9244-b93755a4f298 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.055026 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f972563b-d1b2-4f4f-9244-b93755a4f298 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.055982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f972563b-d1b2-4f4f-9244-b93755a4f298 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.056616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f972563b-d1b2-4f4f-9244-b93755a4f298 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.101521 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f972563b-d1b2-4f4f-9244-b93755a4f298 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments/b9fd3395-af15-4108-8c32-7d2cab48ea8b" status: 200 len: 194 microversion: 2.20 time: 0.059502 May 16 15:26:12.109398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 316/638] 10.222.0.76 () {60 vars in 1453 bytes} [Mon May 16 15:26:12 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments/b9fd3395-af15-4108-8c32-7d2cab48ea8b => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:26:12.125173 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:12.134727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b551a85d-6560-4359-98d8-176137be9185 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1605 microversion: 2.1 time: 0.110124 May 16 15:26:12.135796 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 323/639] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:12 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:12.185119 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:12.185619 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:12.192616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.193265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.193966 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.194441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.286163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lazy-loading 'services' on Instance uuid 031f5d91-18aa-47bd-a848-e09d19e8f6c4 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:12.586878 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-a1f1ac14-d5c7-4547-9285-b6c648b06ba3 req-c67f30e1-350b-43f9-bd1e-9ca796c297fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca077d05-e39f-4ce2-ba17-bc13b0d34bb4", "name": "network-vif-deleted", "tag": "28c42936-ecff-4e27-887a-edf723a14aa4"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:12.593903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5bba4e9f-c0f7-4b4f-8d98-40191b49d459 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments/b9fd3395-af15-4108-8c32-7d2cab48ea8b" status: 202 len: 0 microversion: 2.20 time: 0.412622 May 16 15:26:12.599643 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a1f1ac14-d5c7-4547-9285-b6c648b06ba3 req-c67f30e1-350b-43f9-bd1e-9ca796c297fb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.599643 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-a1f1ac14-d5c7-4547-9285-b6c648b06ba3 req-c67f30e1-350b-43f9-bd1e-9ca796c297fb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.599892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 317/640] 10.222.0.76 () {60 vars in 1456 bytes} [Mon May 16 15:26:12 2022] DELETE /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments/b9fd3395-af15-4108-8c32-7d2cab48ea8b => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:26:12.606456 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-92a6571f-3e33-497c-a33e-7e81150dd6e8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:12.608152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-92a6571f-3e33-497c-a33e-7e81150dd6e8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:12.610430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-a1f1ac14-d5c7-4547-9285-b6c648b06ba3 req-c67f30e1-350b-43f9-bd1e-9ca796c297fb service nova] Creating event network-vif-deleted:28c42936-ecff-4e27-887a-edf723a14aa4 for instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 on hv-cinder-79053 May 16 15:26:12.615504 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-a1f1ac14-d5c7-4547-9285-b6c648b06ba3 req-c67f30e1-350b-43f9-bd1e-9ca796c297fb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034173 May 16 15:26:12.620145 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 324/641] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:26:12.633159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92a6571f-3e33-497c-a33e-7e81150dd6e8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.633616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92a6571f-3e33-497c-a33e-7e81150dd6e8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.634426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92a6571f-3e33-497c-a33e-7e81150dd6e8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.634867 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-92a6571f-3e33-497c-a33e-7e81150dd6e8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.666753 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-92a6571f-3e33-497c-a33e-7e81150dd6e8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065729 May 16 15:26:12.668204 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 318/642] 10.222.0.76 () {60 vars in 1342 bytes} [Mon May 16 15:26:12 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:26:12.759481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:12.760425 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:12.766897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.767422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.768325 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:12.768861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:12.913126 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:12.928273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cf2cde86-b6a2-44d2-b373-e6f1f1fc754c tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.172991 May 16 15:26:12.929066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 325/643] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:12 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:13.154067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:13.154704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:13.161974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.162685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.163509 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.164035 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.196427 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.196888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.197349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lazy-loading 'fault' on Instance uuid ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:13.242390 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:13.250195 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4be8b3b5-362c-4554-915f-c123c9075181 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1326 microversion: 2.1 time: 0.100920 May 16 15:26:13.252531 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 319/644] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:13 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:13.679543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-82c899c6-6247-4562-83ec-2705687582be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:13.680572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-82c899c6-6247-4562-83ec-2705687582be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:13.687189 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82c899c6-6247-4562-83ec-2705687582be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.687642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82c899c6-6247-4562-83ec-2705687582be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.688413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82c899c6-6247-4562-83ec-2705687582be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.688852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-82c899c6-6247-4562-83ec-2705687582be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.718964 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-82c899c6-6247-4562-83ec-2705687582be tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042957 May 16 15:26:13.719882 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 326/645] 10.222.0.76 () {60 vars in 1342 bytes} [Mon May 16 15:26:13 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:26:13.944875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:13.945582 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:13.952486 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.953191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.954066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.954665 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.975205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7b05d8a6-a24f-4e44-ad15-0a1e76978c66 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:13.976446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7b05d8a6-a24f-4e44-ad15-0a1e76978c66 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:13.982464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7b05d8a6-a24f-4e44-ad15-0a1e76978c66 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.987854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7b05d8a6-a24f-4e44-ad15-0a1e76978c66 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:13.987854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7b05d8a6-a24f-4e44-ad15-0a1e76978c66 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:13.987854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7b05d8a6-a24f-4e44-ad15-0a1e76978c66 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.097339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:14.104849 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c18e7553-857d-4cf4-a56e-129e74038145 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1319 microversion: 2.1 time: 0.163944 May 16 15:26:14.105625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 320/646] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:13 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:14.226098 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7b05d8a6-a24f-4e44-ad15-0a1e76978c66 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/action" status: 202 len: 0 microversion: 2.1 time: 0.254503 May 16 15:26:14.229778 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 327/647] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:26:13 2022] POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:26:14.234801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:14.235417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:14.241853 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.242347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.243115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.243554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.268745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:14.269540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:14.275865 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.276390 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.277239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.277744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.309692 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.310250 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.310914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lazy-loading 'fault' on Instance uuid ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:14.356407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:14.363699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e7954a37-b5b0-455d-b721-8b90c53be0d0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 200 len: 1326 microversion: 2.1 time: 0.099185 May 16 15:26:14.373847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 328/648] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:14 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:14.396560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:14.406546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-43b597f3-c688-4a80-a04f-bf76c6eedb11 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1752 microversion: 2.1 time: 0.175464 May 16 15:26:14.407105 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 321/649] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:14 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:14.731334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8581b331-40c1-48cb-b076-1696d9352712 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:14.732293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8581b331-40c1-48cb-b076-1696d9352712 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:14.739391 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8581b331-40c1-48cb-b076-1696d9352712 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.739837 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8581b331-40c1-48cb-b076-1696d9352712 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.740613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8581b331-40c1-48cb-b076-1696d9352712 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:14.741052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8581b331-40c1-48cb-b076-1696d9352712 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:14.772138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8581b331-40c1-48cb-b076-1696d9352712 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045330 May 16 15:26:14.772698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 329/650] 10.222.0.76 () {60 vars in 1342 bytes} [Mon May 16 15:26:14 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:26:15.121083 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:15.122000 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:15.128528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.128983 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.129769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.130454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.348560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:15.356516 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dc86df1c-e42f-4311-93af-89ba4ebedd1f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1509 microversion: 2.1 time: 0.239367 May 16 15:26:15.357091 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 322/651] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:15 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:15.373686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-05ee383c-b64c-4043-80ef-f801f0bd102e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f18e8cd9-a0f4-4675-afc7-e206f629a67a", "device": "/dev/sdb"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:15.376246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-05ee383c-b64c-4043-80ef-f801f0bd102e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:15.382185 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:15.382803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:15.389860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ee383c-b64c-4043-80ef-f801f0bd102e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.390103 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.390680 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.390882 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ee383c-b64c-4043-80ef-f801f0bd102e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.391633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.391766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ee383c-b64c-4043-80ef-f801f0bd102e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.392096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-05ee383c-b64c-4043-80ef-f801f0bd102e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.392237 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.422285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] HTTP exception thrown: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Request method failure captured: May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 HTTP/1.1 May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmv2Eye8ipk9c64_Y7BZgf1h9tjz8iHyyA11nUPEG13SCX6rABxVZ1_R_aJyaJQtxpw1_u52RFOPcrar_EJtBN_888kfMOPtciqiLq3FVtPzKE_IgE6AuuJVGDDU-SfD6qy_gyOOSHpfXz7YJJZHud1wIHgGqRWPiKOrJFPR3-96Vts May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: b360d85257f14f9191b490327c110ba8 May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:26:15.424176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b360d85257f14f9191b490327c110ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b360d85257f14f9191b490327c110ba8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-656783132 May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: b360d85257f14f9191b490327c110ba8 May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-656783132-project May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 6b16118d74774a9ea673d6e0532b8772 May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-656783132-project May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:26:15.425563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': 'ca077d05-e39f-4ce2-ba17-bc13b0d34bb4'} May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:15.426368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:26:15.427609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:26:15.429162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Returning 404 to user: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:15.429162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-74e6086d-bb66-4fde-b833-7b832899accf tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 404 len: 111 microversion: 2.1 time: 0.047253 May 16 15:26:15.430796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 323/652] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:15 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:26:15.435845 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:15.436461 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:15.446700 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.447221 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.448137 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.448647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.593520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:15.599591 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-545f99dc-0475-4798-9ae9-01e57ad5a37a tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1752 microversion: 2.1 time: 0.167509 May 16 15:26:15.600331 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 324/653] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:15 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:15.604542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a4bd1186-309a-4c17-baf2-2b7b1ba60188 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '.version_select at 0x7fddb3d54b80>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:15.711689 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a4bd1186-309a-4c17-baf2-2b7b1ba60188 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564473335" status: 202 len: 0 microversion: 2.1 time: 0.110430 May 16 15:26:15.712203 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 325/654] 10.222.0.76 () {58 vars in 1217 bytes} [Mon May 16 15:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564473335 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:26:15.784410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b8e563c5-aacf-474f-a2be-fa933623bf3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:15.785349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b8e563c5-aacf-474f-a2be-fa933623bf3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:15.805739 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b8e563c5-aacf-474f-a2be-fa933623bf3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.806212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b8e563c5-aacf-474f-a2be-fa933623bf3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.813558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b8e563c5-aacf-474f-a2be-fa933623bf3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.813558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b8e563c5-aacf-474f-a2be-fa933623bf3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.872167 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b8e563c5-aacf-474f-a2be-fa933623bf3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.091859 May 16 15:26:15.878601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 326/655] 10.222.0.76 () {60 vars in 1342 bytes} [Mon May 16 15:26:15 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:15.944774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:15.945277 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:15.951562 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.952008 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.952802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:15.953212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:15.981949 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:26:16.211396 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-771143dd-32b5-4bb0-a2a5-e8bcc6ca8ebb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 204 len: 0 microversion: 2.20 time: 0.270356 May 16 15:26:16.212836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 327/656] 10.222.0.76 () {60 vars in 1279 bytes} [Mon May 16 15:26:15 2022] DELETE /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 16 15:26:16.221816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:16.222751 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:16.228924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:16.229386 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:16.230208 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:16.230654 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:16.274110 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-05ee383c-b64c-4043-80ef-f801f0bd102e tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "POST /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904940 May 16 15:26:16.279506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 330/657] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:26:15 2022] POST /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:16.426304 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:16.434683 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:16.436174 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:16.437334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bb22496a-72b5-49dd-99e9-065d2c1abe95 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.220071 May 16 15:26:16.437889 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 328/658] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:16 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:26:16.617847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:16.618556 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:16.625256 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:16.625698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:16.626748 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:16.627174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:16.763612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8b0c4b56-a09c-40e9-a2fa-20301767036d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'create', calling method: .version_select at 0x7fddb3d9a310>, body: {"keypair": {"name": "tempest-keypair-1281445477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5piQc1uUR1iNsTiDEJLZFgd8Dd9owWKGtB1XLi5YIhL/4NAgqrwMfR6OQBqxR73Dw120h7H0sQtqfFr1ZOIDbUIPqqclSiIZ26dh3KAB6wmcGVsqEhvdwIQwuZiILacQ=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:16.770874 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:16.777489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8b0c4b56-a09c-40e9-a2fa-20301767036d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for project b360d85257f14f9191b490327c110ba8. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:26:16.779320 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5cb1ae35-71a1-4eee-bf2c-eecd01d6a791 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.166074 May 16 15:26:16.779927 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 331/659] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:16 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:16.781959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-8b0c4b56-a09c-40e9-a2fa-20301767036d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for user 6b16118d74774a9ea673d6e0532b8772 and project b360d85257f14f9191b490327c110ba8. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:26:16.843011 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8b0c4b56-a09c-40e9-a2fa-20301767036d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083652 May 16 15:26:16.843527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 329/660] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:26:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:26:17.456971 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:17.457521 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:17.464204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:17.464658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:17.465946 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:17.466413 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:17.613397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:17.620374 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:17.629298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:17.629298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-86430783-85e4-413d-8a74-60163bc9b289 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.170487 May 16 15:26:17.629298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 332/661] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:17 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:17.799940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:17.800572 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:17.806804 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:17.807267 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:17.808049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:17.809086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:18.029145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:18.038819 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-04c93dfb-f3ff-4c36-a46f-7cc39835f5a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.242850 May 16 15:26:18.039528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 330/662] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:17 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:18.641977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:18.643007 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:18.649593 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:18.650043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:18.650902 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:18.651335 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:18.781149 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:18.789717 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:18.791339 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:18.792595 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-17c8be80-1e7e-4e1f-859d-ab7879219a6f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1724 microversion: 2.20 time: 0.154891 May 16 15:26:18.793790 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 333/663] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:18 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:19.057232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:19.057943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:19.064371 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:19.064819 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:19.065617 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:19.066046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:19.365809 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:19.374085 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2abfa236-598e-45b6-ab62-c1e5e464408c tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.321737 May 16 15:26:19.374681 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 331/664] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:19 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:19.811841 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:19.812439 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:19.821071 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:19.821889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:19.823007 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:19.823739 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:19.892611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:19.902031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:19.903673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:19.905463 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1f5d6e4-16f4-4a1f-8350-0ea7b28ea22f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1656 microversion: 2.20 time: 0.098023 May 16 15:26:19.906297 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 334/665] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:19 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:20.172235 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2f452953-a977-4018-9260-4400ef23f0b1 req-efb37b69-7fd2-4434-ba38-4d1e2d98db92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f5d91-18aa-47bd-a848-e09d19e8f6c4", "name": "network-vif-deleted", "tag": "a3126c76-9ed9-4501-8584-9b5b2ba2d62e"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:20.180773 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f452953-a977-4018-9260-4400ef23f0b1 req-efb37b69-7fd2-4434-ba38-4d1e2d98db92 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.183135 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f452953-a977-4018-9260-4400ef23f0b1 req-efb37b69-7fd2-4434-ba38-4d1e2d98db92 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.199732 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2f452953-a977-4018-9260-4400ef23f0b1 req-efb37b69-7fd2-4434-ba38-4d1e2d98db92 service nova] Creating event network-vif-deleted:a3126c76-9ed9-4501-8584-9b5b2ba2d62e for instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 on hv-cinder-79053 May 16 15:26:20.205021 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2f452953-a977-4018-9260-4400ef23f0b1 req-efb37b69-7fd2-4434-ba38-4d1e2d98db92 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037320 May 16 15:26:20.205724 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 332/666] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:20.391663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:20.392414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:20.402106 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.403518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.404501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.405659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.438110 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-444957926", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85d31a74-2e0d-4761-a3e9-16256afe83d7"}], "security_groups": [{"name": "tempest-securitygroup--805216970"}], "key_name": "tempest-keypair-1281445477", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:20.566574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] validate_networks() for [('85d31a74-2e0d-4761-a3e9-16256afe83d7', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:26:20.602948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:20.612263 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7efbd732-9b1c-46d1-a2d8-c0835d1be82f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.224470 May 16 15:26:20.612956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 335/667] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:20 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:20.928099 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:20.930943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:20.935322 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.935773 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.936754 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.937675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.944362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:26:20.944784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:26:20.945249 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:26:20.945649 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:26:20.946049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:26:20.954856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.959605 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.959605 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.959605 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.969394 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:20.969842 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:20.970317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lazy-loading 'fault' on Instance uuid 031f5d91-18aa-47bd-a848-e09d19e8f6c4 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:20.973453 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for project b360d85257f14f9191b490327c110ba8. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:26:20.977877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Getting quotas for user 6b16118d74774a9ea673d6e0532b8772 and project b360d85257f14f9191b490327c110ba8. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:26:20.990568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:26:20.992975 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:26:21.010892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:21.019317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:21.020798 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:21.021966 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cb2b5cdc-a917-442b-a9a8-a817d82078f4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 200 len: 1372 microversion: 2.20 time: 0.098183 May 16 15:26:21.030759 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 336/668] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:20 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:26:21.114406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a9c0bb5b-ca6e-4362-8258-dfc4f2974e4f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.683146 May 16 15:26:21.115233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 333/669] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:26:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:26:21.125622 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d570782b-72db-44d7-80d7-fbb8be7acd2d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:21.126784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d570782b-72db-44d7-80d7-fbb8be7acd2d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:21.185383 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d570782b-72db-44d7-80d7-fbb8be7acd2d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:21.194633 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d570782b-72db-44d7-80d7-fbb8be7acd2d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1237 microversion: 2.1 time: 0.073134 May 16 15:26:21.205524 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 337/670] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:21 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:21.630599 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:21.631387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:21.638206 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:21.638695 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:21.639477 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:21.639943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:21.785715 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:21.794216 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-df810b34-a119-4dac-9b94-85360a73e76e tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.167691 May 16 15:26:21.794782 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 334/671] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:21 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:22.040481 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:22.041009 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:22.047261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.047706 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.048464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.048901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.063979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] HTTP exception thrown: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Request method failure captured: May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 HTTP/1.1 May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv4FdfzLyRfu0uocicFba-ELCXfeFUNI9sKlOs_EFkIu_MCGtsXboehV9qdvk6KAMBtJxnrHmw9aVLQCMACryB8OTBk6RMQIEaABTgurA4Avd0MEwk7iwOmm907YGTkq18FT3i4AhvGxXKMjt-MdBbyjPHeF4mxQQcikYoWOey6yUg May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:26:22.065645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f2241c9641bb401aa9f1c6930c513552", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: d3492cec550a46598e09c48474a4c6fb May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:26:22.071925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '031f5d91-18aa-47bd-a848-e09d19e8f6c4'} May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:22.072855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:26:22.074293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:22.076082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Returning 404 to user: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:22.076082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d5b8042d-6260-4125-a9b6-5c48fcce8fbf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 404 len: 111 microversion: 2.20 time: 0.030736 May 16 15:26:22.076082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 338/672] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:22 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:26:22.076808 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e4eff2e3-9870-49fe-95c0-ba413ef65226 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '.version_select at 0x7fddc01460d0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:22.209126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e4eff2e3-9870-49fe-95c0-ba413ef65226 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050830964" status: 204 len: 0 microversion: 2.20 time: 0.136698 May 16 15:26:22.209699 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 335/673] 10.222.0.76 () {60 vars in 1261 bytes} [Mon May 16 15:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050830964 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:26:22.212959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:22.213634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:22.220576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.221031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.221805 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.222275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.285056 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:22.293175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-71dad59f-234e-4c29-8941-5054f4f89c24 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1241 microversion: 2.1 time: 0.084120 May 16 15:26:22.293824 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 339/674] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:22 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:22.812703 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:22.813410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:22.819333 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.819784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.820548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:22.820980 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:22.968263 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:22.977006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-369deeb6-015b-405f-8673-497fdb4d654b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.169238 May 16 15:26:22.977572 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 336/675] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:22 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:23.054160 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fa520e24-2d8f-44ed-9862-b2f514276a50 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'create', calling method: .version_select at 0x7fddc4e3e0d0>, body: {"keypair": {"name": "tempest-keypair-483001783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb5sDXkGDc9Q57W/KmKtUFGOnkQLib6Tbd/AlLnyPx2UDvc0qqYUc80avJzD8YPl+prpCQJyP7LvRVUbB45nmpSgSsaOeZDaDF+uAs2goXcMxJ5ClpfH7xoUMiXlOtz1w=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:23.068541 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-fa520e24-2d8f-44ed-9862-b2f514276a50 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for project f2241c9641bb401aa9f1c6930c513552. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:26:23.072255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-fa520e24-2d8f-44ed-9862-b2f514276a50 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for user d3492cec550a46598e09c48474a4c6fb and project f2241c9641bb401aa9f1c6930c513552. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:26:23.145874 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fa520e24-2d8f-44ed-9862-b2f514276a50 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.095687 May 16 15:26:23.146502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 340/676] 10.222.0.76 () {62 vars in 1199 bytes} [Mon May 16 15:26:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 16 15:26:23.310958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:23.311748 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:23.317809 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:23.322290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:23.322290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:23.322290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:23.400855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:23.408650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-68966b88-ce8c-4f7b-9bad-9cee55503317 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1297 microversion: 2.1 time: 0.102341 May 16 15:26:23.415487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 337/677] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:23 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:23.994226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:23.994835 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:24.001751 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.002232 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.002994 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.003605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.180405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:24.191452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-203e99d9-2504-4afd-9cd4-0330ca7021c5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.200369 May 16 15:26:24.191664 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 341/678] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:23 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:24.432650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:24.433316 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:24.440294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.441391 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.442152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:24.442787 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:24.690349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:24.700963 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4ce68da2-1687-4d43-80ae-fda579d6d2d7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.272704 May 16 15:26:24.702018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 338/679] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:24 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:25.208855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:25.209392 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:25.217031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:25.217695 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:25.218538 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:25.219040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:25.320124 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-70055432-bd1d-47cf-97f7-92c86b09c6a1 req-7b286e38-31e4-4ea7-8fec-e257b8b0508a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "263af909-b095-4188-82a6-8f6da66d0e96", "tag": "7e202561-b4bc-4d1f-98b5-3234f4c66c40"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:25.334450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-70055432-bd1d-47cf-97f7-92c86b09c6a1 req-7b286e38-31e4-4ea7-8fec-e257b8b0508a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:25.334993 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-70055432-bd1d-47cf-97f7-92c86b09c6a1 req-7b286e38-31e4-4ea7-8fec-e257b8b0508a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:25.352151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-70055432-bd1d-47cf-97f7-92c86b09c6a1 req-7b286e38-31e4-4ea7-8fec-e257b8b0508a service nova] Creating event network-changed:7e202561-b4bc-4d1f-98b5-3234f4c66c40 for instance 263af909-b095-4188-82a6-8f6da66d0e96 on hv-cinder-79053 May 16 15:26:25.358046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-70055432-bd1d-47cf-97f7-92c86b09c6a1 req-7b286e38-31e4-4ea7-8fec-e257b8b0508a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041819 May 16 15:26:25.358907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 339/680] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:26:25.451981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:25.468778 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5ef82edd-b07a-4c0b-946a-f76cadad6cc0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.263555 May 16 15:26:25.470332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 342/681] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:25 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:25.720352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:25.720974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:25.727232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:25.727690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:25.728531 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:25.728982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:25.838735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1397289306", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ca0b759-8171-48eb-a5a7-1c280cfa9338"}], "security_groups": [{"name": "tempest-securitygroup--1433325595"}], "key_name": "tempest-keypair-483001783", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:25.948379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] validate_networks() for [('6ca0b759-8171-48eb-a5a7-1c280cfa9338', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:26:25.974431 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:25.982662 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ef5334db-71df-4ec4-88da-d1df11cecf3e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.268026 May 16 15:26:25.992011 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 340/682] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:25 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:26.361275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:26:26.361738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:26:26.362150 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:26:26.362558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:26:26.362961 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:26:26.372607 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:26.373047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:26.373868 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:26.374345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:26.391001 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for project f2241c9641bb401aa9f1c6930c513552. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:26:26.394980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Getting quotas for user d3492cec550a46598e09c48474a4c6fb and project f2241c9641bb401aa9f1c6930c513552. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:26:26.406225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:26:26.408461 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:26:26.486321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:26.486944 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:26.492894 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:26.493397 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:26.494154 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:26.494590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:26.514113 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b7428b86-dd47-4420-b913-b8576b8d9da3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.679657 May 16 15:26:26.515043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 343/683] 10.222.0.76 () {62 vars in 1187 bytes} [Mon May 16 15:26:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 16 15:26:26.524915 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e67e94e2-fda1-404d-a287-954c29aa9272 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:26.525881 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e67e94e2-fda1-404d-a287-954c29aa9272 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:26.586255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e67e94e2-fda1-404d-a287-954c29aa9272 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:26.594769 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e67e94e2-fda1-404d-a287-954c29aa9272 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:26.596442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e67e94e2-fda1-404d-a287-954c29aa9272 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:26.597606 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e67e94e2-fda1-404d-a287-954c29aa9272 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1281 microversion: 2.20 time: 0.076487 May 16 15:26:26.599047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 344/684] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:26 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:26:26.653910 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:26.662319 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cbd85bef-837d-49f2-8893-e2bd03dad0a7 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.179847 May 16 15:26:26.662959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 341/685] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:26 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:27.054860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:27.055475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:27.061505 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.061956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.062753 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.063190 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.187676 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:27.194909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f029d13d-6a88-4044-a7dd-9131c33e6005 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.199582 May 16 15:26:27.195472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 345/686] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:26 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:27.615898 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:27.616515 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:27.623687 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.624159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.624911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.625364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.679838 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:27.680461 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:27.684948 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:27.687368 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.687822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.688600 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:27.689040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:27.693219 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:27.694764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:27.695864 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8c8ad225-1d9e-4dd9-b06c-beacfda023a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1285 microversion: 2.20 time: 0.083853 May 16 15:26:27.696425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 342/687] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:27 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:27.825389 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:27.833634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b672d68f-89b9-4bff-90c9-d497252a8de9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.157613 May 16 15:26:27.834227 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 346/688] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:27 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:28.211368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:28.211984 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:28.218172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.218624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.219379 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.219837 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.343059 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:28.350330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8f7b92ca-f113-47ce-8c6d-3485cef9c8c0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.142752 May 16 15:26:28.350890 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 343/689] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:28 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:28.714055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:28.714693 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:28.721633 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.722084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.722879 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.723315 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.786056 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:28.793757 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:28.795276 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:28.796370 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-248addf9-31aa-41a4-9a2c-35bea329e8e4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1285 microversion: 2.20 time: 0.086232 May 16 15:26:28.796924 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 347/690] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:28 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:28.850326 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:28.850884 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:28.857123 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.857575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:28.858370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:28.858807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:29.002780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:29.010783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8f0dc351-de5f-413a-9d7f-26347e74e8e4 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.164287 May 16 15:26:29.011349 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 344/691] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:28 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:29.367493 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:29.367957 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:29.374663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:29.378217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:29.378217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:29.378217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:29.499734 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:29.507386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b49b6ad3-b3e0-40f4-94a1-9a50648fa4b3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.143919 May 16 15:26:29.508484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 348/692] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:29 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:29.868385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:29.869026 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:29.875566 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:29.875566 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:29.876506 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:29.877202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:29.937753 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:29.945469 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:29.946982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:29.948075 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-86e3b247-a3b8-4791-99fd-8bdc62547383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1285 microversion: 2.20 time: 0.137813 May 16 15:26:29.948630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 345/693] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:29 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:30.028397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:30.029015 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:30.035346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:30.035796 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:30.036566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:30.037005 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:30.175064 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:30.182839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4723ba8f-c3b7-48dd-b98b-1706ad472a99 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1757 microversion: 2.1 time: 0.158426 May 16 15:26:30.183405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 349/694] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:30 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:30.524422 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:30.525037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:30.531081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:30.531527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:30.532353 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:30.532787 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:30.660487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:30.667898 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5883f705-f272-4952-bfa5-bc475b4e1d7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.147342 May 16 15:26:30.668504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 346/695] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:30 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:30.964897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:30.965433 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:30.971910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:30.972364 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:30.973173 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:30.973619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:31.038784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:31.046918 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:31.048424 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:31.049532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7eb8356f-a061-4c6d-b849-7e4b0a8957e3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1333 microversion: 2.20 time: 0.088619 May 16 15:26:31.050087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 350/696] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:30 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:31.200303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:31.200911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:31.207693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:31.208135 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:31.208889 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:31.209321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:31.350185 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:31.358003 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c83e3ddf-1485-4b1a-b79c-9d67984e93c0 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1760 microversion: 2.1 time: 0.161573 May 16 15:26:31.358620 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 347/697] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:31 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:31.685397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:31.686014 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:31.691959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:31.692407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:31.693170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:31.693609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:31.817221 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:31.824577 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1fbf4916-c4c8-4295-9b94-4006e1b8d465 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.143040 May 16 15:26:31.825153 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 351/698] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:31 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:32.069856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:32.070499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:32.076511 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:32.076964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:32.077765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:32.078239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:32.140340 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:32.148676 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:32.150209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:32.151307 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-447b4de8-0b1d-443d-80ff-39bfa48634d4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1333 microversion: 2.20 time: 0.085382 May 16 15:26:32.151860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 348/699] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:32 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:32.842070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:32.842753 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:32.849662 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:32.850112 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:32.850915 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:32.851349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:32.987534 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:32.994773 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c22c2556-1ce8-45c0-b667-19bc8e352504 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.156527 May 16 15:26:32.995337 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 352/700] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:32 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:33.168621 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:33.169240 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:33.176112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:33.176568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:33.177334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:33.177775 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:33.236591 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:33.244405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:33.245908 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:33.247165 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-182b556f-693c-4fd4-975e-e9fde11bde86 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1333 microversion: 2.20 time: 0.082370 May 16 15:26:33.247722 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 349/701] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:33 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1333 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:34.011929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:34.012720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:34.019304 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:34.019831 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:34.020615 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:34.021050 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:34.146979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:34.154332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a7863df1-b6cc-4408-9663-ee4457af0580 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.146285 May 16 15:26:34.154906 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 353/702] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:34 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:34.264999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:34.265675 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:34.272787 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:34.280417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:34.280417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:34.280417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:34.352560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:34.361330 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:34.362869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:34.364514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8c5479d4-9d64-4e27-9a82-5bf70981eb01 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1341 microversion: 2.20 time: 0.103482 May 16 15:26:34.365236 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 350/703] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:34 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1341 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:35.171491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:35.172846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:35.183245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:35.184423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:35.185227 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:35.185669 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:35.330740 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:35.338350 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a882896a-bf63-424a-bbdb-5c82f609f22a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.170851 May 16 15:26:35.338926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 354/704] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:35 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:35.383030 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:35.383670 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:35.390308 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:35.390762 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:35.394588 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:35.394588 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:35.595102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:35.603270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:35.604798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:35.605909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2503118a-7fc1-41b2-8d87-d3bd27224991 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.226860 May 16 15:26:35.606509 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 351/705] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:35 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:36.356300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:36.357479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:36.365045 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.365501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.366323 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.366940 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.486791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-66756317-6dd1-48c3-9805-bcc82de5f939 req-ccbeaef0-3091-455d-8242-79e33aa6b91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a3d7e6a-43dc-42b0-a663-56ad894c3801", "tag": "588be31f-e001-4d2f-97c9-ef1bb2eeef86"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:36.498752 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-66756317-6dd1-48c3-9805-bcc82de5f939 req-ccbeaef0-3091-455d-8242-79e33aa6b91f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.499450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-66756317-6dd1-48c3-9805-bcc82de5f939 req-ccbeaef0-3091-455d-8242-79e33aa6b91f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.521313 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-66756317-6dd1-48c3-9805-bcc82de5f939 req-ccbeaef0-3091-455d-8242-79e33aa6b91f service nova] Creating event network-changed:588be31f-e001-4d2f-97c9-ef1bb2eeef86 for instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 on hv-cinder-79053 May 16 15:26:36.530895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-66756317-6dd1-48c3-9805-bcc82de5f939 req-ccbeaef0-3091-455d-8242-79e33aa6b91f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147081 May 16 15:26:36.532257 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 352/706] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:36.538281 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-c58c61a0-3dbc-4201-9182-76481ee13131 req-6079625d-87d3-4fbc-bb59-6727c6a9ce8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "263af909-b095-4188-82a6-8f6da66d0e96", "name": "network-vif-plugged", "status": "completed", "tag": "7e202561-b4bc-4d1f-98b5-3234f4c66c40"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:36.547526 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c58c61a0-3dbc-4201-9182-76481ee13131 req-6079625d-87d3-4fbc-bb59-6727c6a9ce8b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.548076 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c58c61a0-3dbc-4201-9182-76481ee13131 req-6079625d-87d3-4fbc-bb59-6727c6a9ce8b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.567825 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-c58c61a0-3dbc-4201-9182-76481ee13131 req-6079625d-87d3-4fbc-bb59-6727c6a9ce8b service nova] Creating event network-vif-plugged:7e202561-b4bc-4d1f-98b5-3234f4c66c40 for instance 263af909-b095-4188-82a6-8f6da66d0e96 on hv-cinder-79053 May 16 15:26:36.568092 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:36.570835 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-c58c61a0-3dbc-4201-9182-76481ee13131 req-6079625d-87d3-4fbc-bb59-6727c6a9ce8b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036914 May 16 15:26:36.571995 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 353/707] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:36.579655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-15ecf9a5-9bd1-455d-ac51-604fcb5f6a75 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.226640 May 16 15:26:36.591267 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 355/708] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:36 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:36.624857 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:36.626443 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:36.633873 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.634433 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.635435 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:36.635944 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:36.862636 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:36.870960 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:36.872418 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:36.873512 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-44c2f3c7-c1af-4020-84b5-65470ab3869c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.253098 May 16 15:26:36.874205 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 354/709] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:36 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:37.596827 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:37.597429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:37.603841 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:37.604308 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:37.605159 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:37.605586 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:37.731182 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:37.739370 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5f512c14-7d7e-4811-8946-da09bbace302 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.146351 May 16 15:26:37.739954 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 356/710] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:37 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:37.891218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:37.891897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:37.898252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:37.898707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:37.899481 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:37.899918 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.037399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:38.046361 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:38.048615 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:38.049883 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b73b7694-c685-4e99-9a61-627db296abd0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.162390 May 16 15:26:38.050677 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 355/711] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:37 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:38.503596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:38.504119 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:38.509887 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:38.510366 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.511124 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:38.511556 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.588603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lazy-loading 'services' on Instance uuid 2b642832-eb11-4777-a0ff-6cefeec8561f {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:38.756868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:38.757473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:38.763454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:38.763908 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.764675 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:38.765111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:38.850914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3b8d72f9-2ed4-4394-b8e5-40e46cba7e34 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f/os-volume_attachments/f18e8cd9-a0f4-4675-afc7-e206f629a67a" status: 202 len: 0 microversion: 2.1 time: 0.351329 May 16 15:26:38.851543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 357/712] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:26:38 2022] DELETE /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f/os-volume_attachments/f18e8cd9-a0f4-4675-afc7-e206f629a67a => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:26:38.985054 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:38.992439 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-14e7379e-3787-4795-acfe-5bbb983110e7 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1362 microversion: 2.1 time: 0.239687 May 16 15:26:38.993012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 356/713] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:38 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:39.069298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:39.069991 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:39.076232 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:39.076679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:39.077447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:39.077883 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:39.233218 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:39.241482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:39.243033 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:39.244139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-33ea8b66-c17e-4694-a92d-0896bf55ee6c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.179048 May 16 15:26:39.244729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 358/714] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:39 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:40.010218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:40.011010 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:40.019188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.019632 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.021031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.021626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.208229 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:40.215624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-97a436ca-929c-4a76-acc2-6a11987d13f5 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1548 microversion: 2.1 time: 0.209535 May 16 15:26:40.216362 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 357/715] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:40 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1548 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:40.233368 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-09c00679-5f79-487c-9c56-29c7f4a42427 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:40.233917 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-09c00679-5f79-487c-9c56-29c7f4a42427 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:40.241248 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09c00679-5f79-487c-9c56-29c7f4a42427 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.242120 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09c00679-5f79-487c-9c56-29c7f4a42427 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.242934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09c00679-5f79-487c-9c56-29c7f4a42427 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.243379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09c00679-5f79-487c-9c56-29c7f4a42427 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.266626 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:40.267664 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:40.274536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.275170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.276376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:40.276961 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:40.323704 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-09c00679-5f79-487c-9c56-29c7f4a42427 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094283 May 16 15:26:40.324306 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 359/716] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:26:40 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:40.442162 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:40.453090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:40.454793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:40.455968 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-53fca1a2-9321-4433-8132-fb28317deea6 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.197732 May 16 15:26:40.456995 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 358/717] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:40 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:41.011204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:41.011709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:41.018193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.018646 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.019414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.019851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.045029 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:26:41.351999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b3a412df-eaa3-45bf-b8ba-64148307aee1 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 204 len: 0 microversion: 2.1 time: 0.344328 May 16 15:26:41.352703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 360/718] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:26:41 2022] DELETE /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:26:41.360866 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:41.362894 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:41.369318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.370037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.371548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.372077 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.475258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:41.475970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:41.487694 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.488395 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.489892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.491209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.521181 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:41.529596 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b9e95017-8bb3-4469-a6f1-ae6964a1fc48 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1515 microversion: 2.1 time: 0.172565 May 16 15:26:41.540405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 359/719] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:41 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:26:41.545593 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-93312989-4d6d-4ddb-b5f4-f1803ec9b459 req-7a25dce4-a0bb-49be-98cf-6b30702fcc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "263af909-b095-4188-82a6-8f6da66d0e96", "tag": "7e202561-b4bc-4d1f-98b5-3234f4c66c40"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:41.553290 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-93312989-4d6d-4ddb-b5f4-f1803ec9b459 req-7a25dce4-a0bb-49be-98cf-6b30702fcc8c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:41.553731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-93312989-4d6d-4ddb-b5f4-f1803ec9b459 req-7a25dce4-a0bb-49be-98cf-6b30702fcc8c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:41.568865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-93312989-4d6d-4ddb-b5f4-f1803ec9b459 req-7a25dce4-a0bb-49be-98cf-6b30702fcc8c service nova] Creating event network-changed:7e202561-b4bc-4d1f-98b5-3234f4c66c40 for instance 263af909-b095-4188-82a6-8f6da66d0e96 on hv-cinder-79053 May 16 15:26:41.574188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-93312989-4d6d-4ddb-b5f4-f1803ec9b459 req-7a25dce4-a0bb-49be-98cf-6b30702fcc8c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032516 May 16 15:26:41.575016 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 360/720] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:41.636388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:41.644863 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:41.646398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:41.647508 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e3b243a9-bc22-4b14-acc8-0f6c1dcf17a9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.178009 May 16 15:26:41.648258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 361/721] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:41 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:26:42.432707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-24a8fc50-6518-48fb-bc57-0f2f56a9a8c7 req-5c6015a4-561b-4959-957f-8d95345419aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3d7e6a-43dc-42b0-a663-56ad894c3801", "name": "network-vif-plugged", "status": "completed", "tag": "588be31f-e001-4d2f-97c9-ef1bb2eeef86"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:42.439051 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-24a8fc50-6518-48fb-bc57-0f2f56a9a8c7 req-5c6015a4-561b-4959-957f-8d95345419aa service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:42.439540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-24a8fc50-6518-48fb-bc57-0f2f56a9a8c7 req-5c6015a4-561b-4959-957f-8d95345419aa service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:42.450958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-24a8fc50-6518-48fb-bc57-0f2f56a9a8c7 req-5c6015a4-561b-4959-957f-8d95345419aa service nova] Creating event network-vif-plugged:588be31f-e001-4d2f-97c9-ef1bb2eeef86 for instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 on hv-cinder-79053 May 16 15:26:42.461759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-24a8fc50-6518-48fb-bc57-0f2f56a9a8c7 req-5c6015a4-561b-4959-957f-8d95345419aa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033780 May 16 15:26:42.461759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 361/722] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:42.548352 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:42.548987 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:42.555549 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:42.555992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:42.556753 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:42.557188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:42.665229 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:42.665921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:42.672032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:42.672476 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:42.673871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:42.674337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:42.695384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:42.703300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0d3990fe-be36-4c11-9a7d-392ca7aa310f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1515 microversion: 2.1 time: 0.159442 May 16 15:26:42.703888 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 362/723] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:42 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:42.802624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:42.810220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:42.811717 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:42.812802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-57e00058-fe5b-4f2c-b4fd-4546fcc2bb88 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.151804 May 16 15:26:42.813352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 362/724] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:42 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:26:43.719787 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:43.720396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:43.726737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:43.727175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:43.727932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:43.728359 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:43.831639 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:43.833018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:43.841310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:43.842108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:43.843187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:43.843867 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:43.866421 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:43.874312 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b9ea5d7b-3f67-40d0-986d-06383ee93b3f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1515 microversion: 2.1 time: 0.158296 May 16 15:26:43.886324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 363/725] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:43 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:44.010870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-67705e07-e49b-4687-9711-bdb920248f3d req-26fc65bc-2993-4d18-8bd4-eb623717a87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b642832-eb11-4777-a0ff-6cefeec8561f", "name": "network-vif-deleted", "tag": "f7a7d96f-fc1c-4598-82d5-2f86bde61ae9"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:44.019409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-67705e07-e49b-4687-9711-bdb920248f3d req-26fc65bc-2993-4d18-8bd4-eb623717a87d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:44.019848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-67705e07-e49b-4687-9711-bdb920248f3d req-26fc65bc-2993-4d18-8bd4-eb623717a87d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:44.030846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-67705e07-e49b-4687-9711-bdb920248f3d req-26fc65bc-2993-4d18-8bd4-eb623717a87d service nova] Creating event network-vif-deleted:f7a7d96f-fc1c-4598-82d5-2f86bde61ae9 for instance 2b642832-eb11-4777-a0ff-6cefeec8561f on hv-cinder-79053 May 16 15:26:44.036334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-67705e07-e49b-4687-9711-bdb920248f3d req-26fc65bc-2993-4d18-8bd4-eb623717a87d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029878 May 16 15:26:44.036932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 364/726] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:44.071590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:44.079921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:44.081426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:44.082564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-45575f07-387d-40da-ac84-a1554bf5df3e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.255484 May 16 15:26:44.083120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 363/727] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:43 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:44.892918 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:44.893618 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:44.899935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:44.900388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:44.901181 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:44.901616 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:44.932624 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:44.933076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:44.933557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lazy-loading 'fault' on Instance uuid 2b642832-eb11-4777-a0ff-6cefeec8561f {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:44.973031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4f36f69496486ab361b2c308826430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e1e9277cbb4651901cbb84564ef9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:44.980196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-87cf2fda-3e8d-4f98-85e7-2a47132e79a3 tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 200 len: 1309 microversion: 2.1 time: 0.091880 May 16 15:26:44.980846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 365/728] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:44 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:45.100706 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:45.101318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:45.107601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:45.108058 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:45.115434 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:45.115434 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:45.240134 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:45.247942 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:45.249454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:45.250599 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aca51d48-9902-4f8d-a787-47424b9e084c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1407 microversion: 2.20 time: 0.153796 May 16 15:26:45.251158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 364/729] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:45 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:45.997395 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:45.998032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] [instance: 2b642832-eb11-4777-a0ff-6cefeec8561f] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:46.005164 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.005612 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:46.006433 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.006891 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:46.019696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] HTTP exception thrown: Instance 2b642832-eb11-4777-a0ff-6cefeec8561f could not be found. May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Request method failure captured: May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f HTTP/1.1 May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmyuF0Sf5aowpUZZddY0FCxQd9iXhUY6PGSMNTyV0AbNAcZgDE19a6F9WtHLdDTytgfEdOs8xx-vLyDY1SgvNhaIK29iuBnPXX5qdZuE7eNa-P7hW-rhebgni74c_9aD_OvMbrkmBcwF_HvnoI_iobNaEKbysiYuAEd4ZoERNZDKxTQ May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 66e1e9277cbb4651901cbb84564ef9bd May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotTestJSON-64347822 May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:26:46.021298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/66e1e9277cbb4651901cbb84564ef9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_66e1e9277cbb4651901cbb84564ef9bd", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/66e1e9277cbb4651901cbb84564ef9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/66e1e9277cbb4651901cbb84564ef9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotTestJSON-64347822 May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 66e1e9277cbb4651901cbb84564ef9bd May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-64347822 May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotTestJSON-64347822-project May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 0f4f36f69496486ab361b2c308826430 May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotTestJSON-64347822-project May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 2b642832-eb11-4777-a0ff-6cefeec8561f could not be found. May 16 15:26:46.022851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '2b642832-eb11-4777-a0ff-6cefeec8561f'} May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b642832-eb11-4777-a0ff-6cefeec8561f could not be found. May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:46.023745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b642832-eb11-4777-a0ff-6cefeec8561f could not be found. May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b642832-eb11-4777-a0ff-6cefeec8561f could not be found. May 16 15:26:46.025348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:46.026747 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] Returning 404 to user: Instance 2b642832-eb11-4777-a0ff-6cefeec8561f could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:46.026747 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-497bb348-c159-44f3-abc9-8d2f88894d7f tempest-VolumesSnapshotTestJSON-64347822 tempest-VolumesSnapshotTestJSON-64347822-project] 10.222.0.76 "GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f" status: 404 len: 111 microversion: 2.1 time: 0.029139 May 16 15:26:46.026747 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 366/730] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:45 2022] GET /compute/v2.1/servers/2b642832-eb11-4777-a0ff-6cefeec8561f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:26:46.268392 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:46.268921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:46.275191 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.275647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:46.276442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.276876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:46.408098 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:46.415843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:46.417356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:46.418549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-64e51a7f-7ca1-4054-8de1-b644c83dcfcf tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1598 microversion: 2.20 time: 0.154045 May 16 15:26:46.419104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 365/731] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:26:46 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:26:46.436180 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-69af8983-5b16-493e-a23d-cd752e81cc23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:46.436668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-69af8983-5b16-493e-a23d-cd752e81cc23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:46.442530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69af8983-5b16-493e-a23d-cd752e81cc23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.447550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69af8983-5b16-493e-a23d-cd752e81cc23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:46.447550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69af8983-5b16-493e-a23d-cd752e81cc23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:46.447550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-69af8983-5b16-493e-a23d-cd752e81cc23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:46.520347 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-69af8983-5b16-493e-a23d-cd752e81cc23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087870 May 16 15:26:46.521195 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 367/732] 10.222.0.76 () {60 vars in 1315 bytes} [Mon May 16 15:26:46 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:26:47.034824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:47.035321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:47.041156 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:47.041548 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:47.042377 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:47.042784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:47.120045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lazy-loading 'services' on Instance uuid d0316dc2-94eb-4a8c-811e-057cbe5fd20e {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:47.300147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-64faa881-4b68-41b6-b619-ee2b2fbbe88a tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments/0906d85b-9ce3-4953-a020-47169db7ed4d" status: 202 len: 0 microversion: 2.1 time: 0.269498 May 16 15:26:47.300797 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 366/733] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:26:47 2022] DELETE /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments/0906d85b-9ce3-4953-a020-47169db7ed4d => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:26:47.309660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a941a2e4-a3f1-4a8b-b587-0ea800a803da tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:47.310822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a941a2e4-a3f1-4a8b-b587-0ea800a803da tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:47.316879 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a941a2e4-a3f1-4a8b-b587-0ea800a803da tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:47.317333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a941a2e4-a3f1-4a8b-b587-0ea800a803da tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:47.318196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a941a2e4-a3f1-4a8b-b587-0ea800a803da tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:47.318638 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a941a2e4-a3f1-4a8b-b587-0ea800a803da tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:47.348249 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a941a2e4-a3f1-4a8b-b587-0ea800a803da tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043085 May 16 15:26:47.348814 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 368/734] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:26:47 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:47.480509 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-86ab2b28-8c10-4934-95c6-fa4e0ef7e306 req-7c5e3f28-bed6-4584-b669-72d4ef49ac40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a3d7e6a-43dc-42b0-a663-56ad894c3801", "tag": "588be31f-e001-4d2f-97c9-ef1bb2eeef86"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:47.488907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-86ab2b28-8c10-4934-95c6-fa4e0ef7e306 req-7c5e3f28-bed6-4584-b669-72d4ef49ac40 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:47.489358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-86ab2b28-8c10-4934-95c6-fa4e0ef7e306 req-7c5e3f28-bed6-4584-b669-72d4ef49ac40 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:47.500676 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-86ab2b28-8c10-4934-95c6-fa4e0ef7e306 req-7c5e3f28-bed6-4584-b669-72d4ef49ac40 service nova] Creating event network-changed:588be31f-e001-4d2f-97c9-ef1bb2eeef86 for instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 on hv-cinder-79053 May 16 15:26:47.505954 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-86ab2b28-8c10-4934-95c6-fa4e0ef7e306 req-7c5e3f28-bed6-4584-b669-72d4ef49ac40 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029362 May 16 15:26:47.506611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 367/735] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:48.360081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ed84d5af-d077-491b-81cd-507e39d71f37 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:48.361160 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ed84d5af-d077-491b-81cd-507e39d71f37 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:48.367872 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed84d5af-d077-491b-81cd-507e39d71f37 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:48.368319 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed84d5af-d077-491b-81cd-507e39d71f37 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:48.369296 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed84d5af-d077-491b-81cd-507e39d71f37 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:48.369739 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed84d5af-d077-491b-81cd-507e39d71f37 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:48.400581 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ed84d5af-d077-491b-81cd-507e39d71f37 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 May 16 15:26:48.401062 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 369/736] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:26:48 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:49.413035 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-12c1fe18-2256-4df0-b7f7-d1607682015d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:49.414049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-12c1fe18-2256-4df0-b7f7-d1607682015d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:49.420142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12c1fe18-2256-4df0-b7f7-d1607682015d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.420595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12c1fe18-2256-4df0-b7f7-d1607682015d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.421357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12c1fe18-2256-4df0-b7f7-d1607682015d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:49.421794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-12c1fe18-2256-4df0-b7f7-d1607682015d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:49.450060 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-12c1fe18-2256-4df0-b7f7-d1607682015d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041770 May 16 15:26:49.450647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 368/737] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:26:49 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:50.461783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-820be074-4fbc-4e20-9d3c-d2f98ffc855c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:50.462742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-820be074-4fbc-4e20-9d3c-d2f98ffc855c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:50.472512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-820be074-4fbc-4e20-9d3c-d2f98ffc855c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:50.472963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-820be074-4fbc-4e20-9d3c-d2f98ffc855c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:50.473736 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-820be074-4fbc-4e20-9d3c-d2f98ffc855c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:50.474202 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-820be074-4fbc-4e20-9d3c-d2f98ffc855c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:50.504541 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-820be074-4fbc-4e20-9d3c-d2f98ffc855c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 May 16 15:26:50.505246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 370/738] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:26:50 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:51.516603 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-21844a70-0b24-4b67-b568-b91289fb92a8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:51.517531 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-21844a70-0b24-4b67-b568-b91289fb92a8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:51.524409 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21844a70-0b24-4b67-b568-b91289fb92a8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.524860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21844a70-0b24-4b67-b568-b91289fb92a8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.525625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21844a70-0b24-4b67-b568-b91289fb92a8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.526063 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-21844a70-0b24-4b67-b568-b91289fb92a8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.554387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-21844a70-0b24-4b67-b568-b91289fb92a8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041891 May 16 15:26:51.554933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 369/739] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:26:51 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:26:51.632582 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:51.633134 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:51.639479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.639932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.640699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:51.641137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:51.668225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:26:51.983818 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bdb4922a-c1b9-4d92-a7bf-e80d469252e8 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 204 len: 0 microversion: 2.1 time: 0.355100 May 16 15:26:51.984406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 371/740] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:26:51 2022] DELETE /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:26:51.993036 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:51.993653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:51.999790 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:52.000932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:52.001047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:52.001423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:52.384223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:52.392564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4a9d2be2-897f-45bb-a83b-c3b4dce90c82 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1688 microversion: 2.1 time: 0.402765 May 16 15:26:52.392564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 370/741] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:51 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1688 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:53.409310 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:53.410004 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:53.416381 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:53.416832 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:53.417601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:53.418037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:53.568934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:53.576321 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6b256b64-3f34-41c7-b552-141dcd613b8b tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1688 microversion: 2.1 time: 0.171327 May 16 15:26:53.576873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 372/742] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:53 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:54.592898 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:54.593514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:54.599819 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:54.600278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:54.601107 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:54.601550 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:54.727683 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:54.735057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-529be3b9-e134-4630-bebd-4b3b8519ecf0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1688 microversion: 2.1 time: 0.146079 May 16 15:26:54.737576 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 371/743] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:54 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:55.751875 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:55.752730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:55.759938 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:55.760390 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:55.761167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:55.761605 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:55.891212 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:55.899839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e344ba4c-004e-4561-a603-16cc33f1a9c0 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1688 microversion: 2.1 time: 0.151891 May 16 15:26:55.909762 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 373/744] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:55 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:56.659197 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-ce76156c-3f28-4608-9883-7f139d99dbd6 req-341fb614-a3e4-4e01-bece-1ca0e97427b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0316dc2-94eb-4a8c-811e-057cbe5fd20e", "name": "network-vif-deleted", "tag": "5932ef72-da59-4163-b091-83604c0d8211"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:26:56.667684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ce76156c-3f28-4608-9883-7f139d99dbd6 req-341fb614-a3e4-4e01-bece-1ca0e97427b7 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:56.668156 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-ce76156c-3f28-4608-9883-7f139d99dbd6 req-341fb614-a3e4-4e01-bece-1ca0e97427b7 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:56.680692 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-ce76156c-3f28-4608-9883-7f139d99dbd6 req-341fb614-a3e4-4e01-bece-1ca0e97427b7 service nova] Creating event network-vif-deleted:5932ef72-da59-4163-b091-83604c0d8211 for instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e on hv-cinder-79053 May 16 15:26:56.686041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-ce76156c-3f28-4608-9883-7f139d99dbd6 req-341fb614-a3e4-4e01-bece-1ca0e97427b7 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031127 May 16 15:26:56.687058 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 372/745] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:26:56.916869 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:56.917998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:56.924384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:56.924829 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:56.925601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:56.926030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:56.998731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:57.007273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-717c31c5-5ab8-426c-bf56-effa8bb844a2 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1330 microversion: 2.1 time: 0.094224 May 16 15:26:57.013417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 374/746] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:56 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:58.025504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:58.026118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:58.032419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:58.032904 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:58.033684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:58.034145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:58.065861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:58.066353 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:58.066803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lazy-loading 'fault' on Instance uuid d0316dc2-94eb-4a8c-811e-057cbe5fd20e {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:26:58.108049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:26:58.115189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2f902206-beb2-4524-b021-e97891b2163d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 200 len: 1335 microversion: 2.1 time: 0.094929 May 16 15:26:58.115756 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 373/747] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:58 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:26:59.132084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:59.132681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: d0316dc2-94eb-4a8c-811e-057cbe5fd20e] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:26:59.139062 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:59.139511 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:59.140276 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:26:59.140713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:26:59.153561 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] HTTP exception thrown: Instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e could not be found. May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Request method failure captured: May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e HTTP/1.1 May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv7qQTE8tLG33ej85dpt73LbP7nYUSJFQ4d_TW8DLi35Kx1Qbez_5294G-bCVt3blhIw7HkMV9SgEmA95NLP9nihR4FJu9fM_RWvQ39NM9g_RsA_tCDanLg4bewbec122zNONg-LfnoskEuA5-IgViyeb7Q7n588qsHtvtbhUPVAUM May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:26:59.155196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c3c3d75e638a4871b548ba689eeddeda", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6c6b9438bb4245b3908664bfece4ef22 May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e could not be found. May 16 15:26:59.156720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'd0316dc2-94eb-4a8c-811e-057cbe5fd20e'} May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e could not be found. May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:26:59.157727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e could not be found. May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e could not be found. May 16 15:26:59.159121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:26:59.160721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Returning 404 to user: Instance d0316dc2-94eb-4a8c-811e-057cbe5fd20e could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:26:59.160721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1eb6e3fd-180a-4c03-87fb-4bf96cf45f4d tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e" status: 404 len: 111 microversion: 2.1 time: 0.028701 May 16 15:26:59.160721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 375/748] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:26:59 2022] GET /compute/v2.1/servers/d0316dc2-94eb-4a8c-811e-057cbe5fd20e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:26:59.165518 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3c2033be-b80f-4a15-8bcc-da87cd83d4c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '.version_select at 0x7fddb3cb1ca0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:26:59.293056 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3c2033be-b80f-4a15-8bcc-da87cd83d4c6 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800306307" status: 202 len: 0 microversion: 2.1 time: 0.131745 May 16 15:26:59.293633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 374/749] 10.222.0.76 () {58 vars in 1217 bytes} [Mon May 16 15:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800306307 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:02.668196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:02.668718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:02.675045 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:02.675487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:02.676241 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:02.676673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:02.701870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:27:02.966564 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ee6a7de8-4a29-4c10-ad6a-98670a933f41 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 204 len: 0 microversion: 2.1 time: 0.301800 May 16 15:27:02.967179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 376/750] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:27:02 2022] DELETE /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:27:02.975844 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:02.981690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:02.983188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:02.983650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:02.984423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:02.984864 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:03.114942 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:03.123653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-563deffa-40ab-4d8a-ae5b-951977b111bf tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1508 microversion: 2.1 time: 0.152297 May 16 15:27:03.124229 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 375/751] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:02 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:04.142553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:04.143249 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:04.150884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:04.151285 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:04.152240 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:04.152681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:04.282268 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:04.289817 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-845e5a82-ad1b-4c5d-9707-e3ca68b9ca68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1508 microversion: 2.1 time: 0.151797 May 16 15:27:04.290420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 377/752] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:04 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:05.308577 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:05.308577 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:05.313714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:05.314205 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:05.314973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:05.315409 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:05.490995 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-9dc85b11-cdad-4da2-b134-37afc7398402 req-0be2be50-4187-41e7-816f-94c61a5bec03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea", "name": "network-vif-deleted", "tag": "24dcea07-8fae-4145-a733-6a29da9a079a"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:05.502247 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9dc85b11-cdad-4da2-b134-37afc7398402 req-0be2be50-4187-41e7-816f-94c61a5bec03 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:05.506705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-9dc85b11-cdad-4da2-b134-37afc7398402 req-0be2be50-4187-41e7-816f-94c61a5bec03 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:05.521472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-9dc85b11-cdad-4da2-b134-37afc7398402 req-0be2be50-4187-41e7-816f-94c61a5bec03 service nova] Creating event network-vif-deleted:24dcea07-8fae-4145-a733-6a29da9a079a for instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea on hv-cinder-79053 May 16 15:27:05.527130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:05.533822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-9dc85b11-cdad-4da2-b134-37afc7398402 req-0be2be50-4187-41e7-816f-94c61a5bec03 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047222 May 16 15:27:05.534530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 378/753] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:27:05.540830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-44c98c81-5e2e-4964-a2a1-ee4272789251 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 200 len: 1508 microversion: 2.1 time: 0.237702 May 16 15:27:05.542263 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 376/754] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:05 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:06.560914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:06.561534 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:06.567693 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:06.568166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:06.568920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:06.569430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:06.582512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] HTTP exception thrown: Instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea could not be found. May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Request method failure captured: May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea HTTP/1.1 May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv7qQTE8tLG33ej85dpt73LbP7nYUSJFQ4d_TW8DLi35Kx1Qbez_5294G-bCVt3blhIw7HkMV9SgEmA95NLP9nihR4FJu9fM_RWvQ39NM9g_RsA_tCDanLg4bewbec122zNONg-LfnoskEuA5-IgViyeb7Q7n588qsHtvtbhUPVAUM May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:27:06.584171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c3c3d75e638a4871b548ba689eeddeda", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6c6b9438bb4245b3908664bfece4ef22 May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea could not be found. May 16 15:27:06.585726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea'} May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea could not be found. May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:06.587468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea could not be found. May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea could not be found. May 16 15:27:06.588896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:06.590846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Returning 404 to user: Instance ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:06.590846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-680fdae9-6810-450a-aff9-a102778432bb tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea" status: 404 len: 111 microversion: 2.1 time: 0.029394 May 16 15:27:06.590846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 379/755] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:06 2022] GET /compute/v2.1/servers/ecbd0c09-83c6-4c3c-87a9-c5ad92e0cbea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:06.594114 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:06.594648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:06.601150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:06.602114 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:06.602902 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:06.603334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:06.628881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:27:06.898335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b19e0cca-100f-4e75-8881-77fbcbbf2771 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 204 len: 0 microversion: 2.1 time: 0.307660 May 16 15:27:06.898999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 377/756] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:27:06 2022] DELETE /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:27:06.908278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:06.908939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:06.914931 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:06.915384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:06.916157 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:06.916591 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:07.045185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:07.052432 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f4393709-68b1-4959-9d42-bbb7e7d11d2f tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.148014 May 16 15:27:07.052995 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 380/757] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:06 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:08.069079 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:08.069774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:08.076476 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:08.077144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:08.077915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:08.078382 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:08.204621 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:08.212047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-355c1206-7802-471a-84f0-f971130a6d6c tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.147143 May 16 15:27:08.212602 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 378/758] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:08 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:09.229751 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:09.230441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:09.236764 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:09.237218 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:09.238024 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:09.238486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:09.370009 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:09.378027 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-28c21ac6-f148-4d15-b25e-685c9a77cb68 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1520 microversion: 2.1 time: 0.152589 May 16 15:27:09.379063 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 381/759] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:09 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:10.330951 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-b0881eec-10c1-454e-a5b2-8c8a64b68219 req-601d8317-4a7b-4649-90b8-f509bb8797db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a560909-2499-4a61-8c4e-90438829ff82", "name": "network-vif-deleted", "tag": "800fd8b6-f49e-4bc2-839c-1036a8769d6e"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:10.340131 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b0881eec-10c1-454e-a5b2-8c8a64b68219 req-601d8317-4a7b-4649-90b8-f509bb8797db service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:10.343116 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b0881eec-10c1-454e-a5b2-8c8a64b68219 req-601d8317-4a7b-4649-90b8-f509bb8797db service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:10.354398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-b0881eec-10c1-454e-a5b2-8c8a64b68219 req-601d8317-4a7b-4649-90b8-f509bb8797db service nova] Creating event network-vif-deleted:800fd8b6-f49e-4bc2-839c-1036a8769d6e for instance 5a560909-2499-4a61-8c4e-90438829ff82 on hv-cinder-79053 May 16 15:27:10.360801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-b0881eec-10c1-454e-a5b2-8c8a64b68219 req-601d8317-4a7b-4649-90b8-f509bb8797db service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 May 16 15:27:10.361426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 379/760] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:10.395185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:10.395800 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:10.403342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:10.403903 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:10.404778 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:10.405278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:10.465931 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c6b9438bb4245b3908664bfece4ef22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c3d75e638a4871b548ba689eeddeda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:10.473408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-976289df-0b16-4956-8380-53c62e450c55 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 200 len: 1478 microversion: 2.1 time: 0.082172 May 16 15:27:10.473966 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 382/761] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:10 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 1478 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:11.491235 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:11.491935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] [instance: 5a560909-2499-4a61-8c4e-90438829ff82] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:11.498549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:11.499007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:11.499826 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:11.500268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:11.516230 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] HTTP exception thrown: Instance 5a560909-2499-4a61-8c4e-90438829ff82 could not be found. May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Request method failure captured: May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 HTTP/1.1 May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmv7qQTE8tLG33ej85dpt73LbP7nYUSJFQ4d_TW8DLi35Kx1Qbez_5294G-bCVt3blhIw7HkMV9SgEmA95NLP9nihR4FJu9fM_RWvQ39NM9g_RsA_tCDanLg4bewbec122zNONg-LfnoskEuA5-IgViyeb7Q7n588qsHtvtbhUPVAUM May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:27:11.517828 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c3c3d75e638a4871b548ba689eeddeda", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c3c3d75e638a4871b548ba689eeddeda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: c3c3d75e638a4871b548ba689eeddeda May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2077108610 May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 6c6b9438bb4245b3908664bfece4ef22 May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2077108610-project May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 5a560909-2499-4a61-8c4e-90438829ff82 could not be found. May 16 15:27:11.519441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '5a560909-2499-4a61-8c4e-90438829ff82'} May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a560909-2499-4a61-8c4e-90438829ff82 could not be found. May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:11.520247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a560909-2499-4a61-8c4e-90438829ff82 could not be found. May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a560909-2499-4a61-8c4e-90438829ff82 could not be found. May 16 15:27:11.521475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:11.522631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] Returning 404 to user: Instance 5a560909-2499-4a61-8c4e-90438829ff82 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:11.522631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-90354e53-8b6a-46be-920f-460c5dcd0713 tempest-ServerRescueNegativeTestJSON-2077108610 tempest-ServerRescueNegativeTestJSON-2077108610-project] 10.222.0.76 "GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82" status: 404 len: 111 microversion: 2.1 time: 0.033182 May 16 15:27:11.522631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 380/762] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:11 2022] GET /compute/v2.1/servers/5a560909-2499-4a61-8c4e-90438829ff82 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:13.703668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1440232428"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:13.704317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:13.711081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:13.711690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:13.712473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:13.712911 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:13.930721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.network.security_group_api [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Removing security group 086037b6-0729-4e22-b718-40f3c5f17796 from port 7f2dac2d-8507-4083-81bf-4f66b2f74796 May 16 15:27:14.888763 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-517b4087-4f28-4d6c-95ea-5fe0027606cc tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/action" status: 202 len: 0 microversion: 2.1 time: 1.189669 May 16 15:27:14.890056 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 383/763] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:27:13 2022] POST /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/action => generated 0 bytes in 1192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:15.192148 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-49203ed7-c20a-4d6b-9982-cdf7593e3a62 req-30e2a3b9-726d-4593-8938-d8b0e669f915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5887d24b-6885-49f4-99d0-7f99f99536cc", "tag": "7f2dac2d-8507-4083-81bf-4f66b2f74796"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:15.201617 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-49203ed7-c20a-4d6b-9982-cdf7593e3a62 req-30e2a3b9-726d-4593-8938-d8b0e669f915 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:15.202163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-49203ed7-c20a-4d6b-9982-cdf7593e3a62 req-30e2a3b9-726d-4593-8938-d8b0e669f915 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:15.214480 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-49203ed7-c20a-4d6b-9982-cdf7593e3a62 req-30e2a3b9-726d-4593-8938-d8b0e669f915 service nova] Creating event network-changed:7f2dac2d-8507-4083-81bf-4f66b2f74796 for instance 5887d24b-6885-49f4-99d0-7f99f99536cc on hv-cinder-79053 May 16 15:27:15.219925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-49203ed7-c20a-4d6b-9982-cdf7593e3a62 req-30e2a3b9-726d-4593-8938-d8b0e669f915 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315337 May 16 15:27:15.222543 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 381/764] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:16.246680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:16.247298 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:16.254567 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:16.255023 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:16.256072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:16.256507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:16.353074 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lazy-loading 'services' on Instance uuid 5887d24b-6885-49f4-99d0-7f99f99536cc {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:27:16.624216 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-40dd636c-b97b-4143-a1a4-db75581298fd tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments/c64a1af1-98a3-48e9-b5f4-17e433c98d21" status: 202 len: 0 microversion: 2.1 time: 0.383571 May 16 15:27:16.624816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 384/765] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:27:16 2022] DELETE /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments/c64a1af1-98a3-48e9-b5f4-17e433c98d21 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:16.634694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-333b9883-8876-484e-986c-a58d07bd0583 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:16.635717 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-333b9883-8876-484e-986c-a58d07bd0583 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:16.642847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-333b9883-8876-484e-986c-a58d07bd0583 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:16.643335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-333b9883-8876-484e-986c-a58d07bd0583 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:16.644153 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-333b9883-8876-484e-986c-a58d07bd0583 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:16.644602 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-333b9883-8876-484e-986c-a58d07bd0583 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:16.676732 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-333b9883-8876-484e-986c-a58d07bd0583 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 May 16 15:27:16.677415 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 382/766] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:27:16 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:17.236646 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-33920c37-2a9f-481f-9555-0e5f3018db71 req-3b0a9691-288a-4592-a87c-cd812d6e7e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5887d24b-6885-49f4-99d0-7f99f99536cc", "tag": "7f2dac2d-8507-4083-81bf-4f66b2f74796"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:17.256889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-33920c37-2a9f-481f-9555-0e5f3018db71 req-3b0a9691-288a-4592-a87c-cd812d6e7e90 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:17.256889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-33920c37-2a9f-481f-9555-0e5f3018db71 req-3b0a9691-288a-4592-a87c-cd812d6e7e90 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:17.434878 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-33920c37-2a9f-481f-9555-0e5f3018db71 req-3b0a9691-288a-4592-a87c-cd812d6e7e90 service nova] Creating event network-changed:7f2dac2d-8507-4083-81bf-4f66b2f74796 for instance 5887d24b-6885-49f4-99d0-7f99f99536cc on hv-cinder-79053 May 16 15:27:17.439861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-33920c37-2a9f-481f-9555-0e5f3018db71 req-3b0a9691-288a-4592-a87c-cd812d6e7e90 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207884 May 16 15:27:17.440517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 385/767] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:17.689269 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-611f9a21-9e85-44c2-a192-a1795c72a66d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:17.700999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-611f9a21-9e85-44c2-a192-a1795c72a66d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:17.700999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-611f9a21-9e85-44c2-a192-a1795c72a66d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:17.700999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-611f9a21-9e85-44c2-a192-a1795c72a66d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:17.700999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-611f9a21-9e85-44c2-a192-a1795c72a66d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:17.701405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-611f9a21-9e85-44c2-a192-a1795c72a66d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:17.729097 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-611f9a21-9e85-44c2-a192-a1795c72a66d tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 May 16 15:27:17.731435 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 383/768] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:27:17 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:18.211813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-935f898f-2e6b-486b-a13d-27d58fbd26a5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Action: 'create', calling method: .version_select at 0x7fddc4e1fa60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1207052135", "metadata": {"Type": "work"}}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-935f898f-2e6b-486b-a13d-27d58fbd26a5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Request method failure captured: May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 122 May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm1W1ugwIBs6QPFTSnLI2Mtaezwc4jAFlcbDQYKpRe5RR_TCp4Kuo4iMIBFliVYt5_ar_Betq6_C1iuiKpEuJjJoczbXbK6n3mqUu21VIF_Shcg-pTMOzka4-rVNl67TOqbDXA_CpSwB_1HixTtZMP7gl_LBDa_5cnDm1z_5T3twGQw May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:27:18.229230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_10ec56d48dd54e36b1607f30ff55edca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: cdf7dc6769bb49ae9491c31cf289c90a May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1207052135", "metadata": {"Type": "work"}}} May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: May 16 15:27:18.230846 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1207052135', 'metadata': {'Type': 'work'}}}} May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise error May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi '#$%' May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:18.231823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:27:18.233264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:27:18.234408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 16 15:27:18.234408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.234408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-935f898f-2e6b-486b-a13d-27d58fbd26a5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:18.234408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-935f898f-2e6b-486b-a13d-27d58fbd26a5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128607 May 16 15:27:18.234408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 386/769] 10.222.0.76 () {60 vars in 1155 bytes} [Mon May 16 15:27:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:27:18.240359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d46278a1-4d37-4517-b556-1534eef398cb tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Action: 'create', calling method: .version_select at 0x7fddb3d9aa60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1109848810", "metadata": {"Type": "work"}}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d46278a1-4d37-4517-b556-1534eef398cb tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Request method failure captured: May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 120 May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm1W1ugwIBs6QPFTSnLI2Mtaezwc4jAFlcbDQYKpRe5RR_TCp4Kuo4iMIBFliVYt5_ar_Betq6_C1iuiKpEuJjJoczbXbK6n3mqUu21VIF_Shcg-pTMOzka4-rVNl67TOqbDXA_CpSwB_1HixTtZMP7gl_LBDa_5cnDm1z_5T3twGQw May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:27:18.244171 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_10ec56d48dd54e36b1607f30ff55edca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: cdf7dc6769bb49ae9491c31cf289c90a May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1109848810", "metadata": {"Type": "work"}}} May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: May 16 15:27:18.245691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1109848810', 'metadata': {'Type': 'work'}}}} May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise error May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi '0' May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:18.246736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:27:18.248252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:27:18.254499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 16 15:27:18.254499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.254499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d46278a1-4d37-4517-b556-1534eef398cb tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:18.254499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d46278a1-4d37-4517-b556-1534eef398cb tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009118 May 16 15:27:18.254499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 384/770] 10.222.0.76 () {60 vars in 1155 bytes} [Mon May 16 15:27:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:27:18.255709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-25b5da1f-2c03-491d-abe6-a9712970b5d5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Action: 'create', calling method: .version_select at 0x7fddb3c71550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1299034423", "metadata": {"Type": "work"}}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-25b5da1f-2c03-491d-abe6-a9712970b5d5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Request method failure captured: May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 119 May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm1W1ugwIBs6QPFTSnLI2Mtaezwc4jAFlcbDQYKpRe5RR_TCp4Kuo4iMIBFliVYt5_ar_Betq6_C1iuiKpEuJjJoczbXbK6n3mqUu21VIF_Shcg-pTMOzka4-rVNl67TOqbDXA_CpSwB_1HixTtZMP7gl_LBDa_5cnDm1z_5T3twGQw May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:27:18.259166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_10ec56d48dd54e36b1607f30ff55edca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: cdf7dc6769bb49ae9491c31cf289c90a May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1299034423", "metadata": {"Type": "work"}}} May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: May 16 15:27:18.261101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1299034423', 'metadata': {'Type': 'work'}}}} May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise error May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi On instance['volume']: May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi '' May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:18.261959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 16 15:27:18.263273 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 16 15:27:18.264369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 16 15:27:18.264369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.264369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-25b5da1f-2c03-491d-abe6-a9712970b5d5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:18.264369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-25b5da1f-2c03-491d-abe6-a9712970b5d5 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009961 May 16 15:27:18.264369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 387/771] 10.222.0.76 () {60 vars in 1155 bytes} [Mon May 16 15:27:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:27:18.269317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f283169-f736-4644-ace8-bb1a56c8fc04 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Calling method '.version_select at 0x7fddb3de5c10>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-8f283169-f736-4644-ace8-bb1a56c8fc04 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] HTTP exception thrown: Volume tempest-invalid-1225748844 could not be found. May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f283169-f736-4644-ace8-bb1a56c8fc04 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Request method failure captured: May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1225748844 HTTP/1.1 May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm1W1ugwIBs6QPFTSnLI2Mtaezwc4jAFlcbDQYKpRe5RR_TCp4Kuo4iMIBFliVYt5_ar_Betq6_C1iuiKpEuJjJoczbXbK6n3mqUu21VIF_Shcg-pTMOzka4-rVNl67TOqbDXA_CpSwB_1HixTtZMP7gl_LBDa_5cnDm1z_5T3twGQw May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:27:18.302545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_10ec56d48dd54e36b1607f30ff55edca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: cdf7dc6769bb49ae9491c31cf289c90a May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Volume tempest-invalid-1225748844 could not be found. May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': 'tempest-invalid-1225748844'} May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:18.304037 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1225748844 could not be found. (HTTP 404) (Request-ID: req-6c8a8b96-cb9b-442d-adf5-1cabe6e7fd86) May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.304887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:27:18.306608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1225748844 could not be found. May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:18.307650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1225748844 could not be found. May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1225748844 could not be found. May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8f283169-f736-4644-ace8-bb1a56c8fc04 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Returning 404 to user: Volume tempest-invalid-1225748844 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8f283169-f736-4644-ace8-bb1a56c8fc04 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1225748844" status: 404 len: 99 microversion: 2.1 time: 0.037466 May 16 15:27:18.309347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 385/772] 10.222.0.76 () {58 vars in 1217 bytes} [Mon May 16 15:27:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1225748844 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 16 15:27:18.313223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d1c42704-7113-43ca-a282-9cf60ee3aa6c tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004033 May 16 15:27:18.313711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 388/773] 10.222.0.76 () {58 vars in 1139 bytes} [Mon May 16 15:27:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 15:27:18.324063 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b211c4e0-a03a-4172-b23f-81b7f19bc09e tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004308 May 16 15:27:18.324553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 386/774] 10.222.0.76 () {58 vars in 1136 bytes} [Mon May 16 15:27:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 16 15:27:18.332750 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11e0fc20-0248-4809-8a91-4340a4f5f1ca tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Calling method '.version_select at 0x7fddc4e1f550>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:18.359500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-11e0fc20-0248-4809-8a91-4340a4f5f1ca tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] HTTP exception thrown: Volume b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 could not be found. May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11e0fc20-0248-4809-8a91-4340a4f5f1ca tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Request method failure captured: May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/os-volumes/b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 HTTP/1.1 May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm1W1ugwIBs6QPFTSnLI2Mtaezwc4jAFlcbDQYKpRe5RR_TCp4Kuo4iMIBFliVYt5_ar_Betq6_C1iuiKpEuJjJoczbXbK6n3mqUu21VIF_Shcg-pTMOzka4-rVNl67TOqbDXA_CpSwB_1HixTtZMP7gl_LBDa_5cnDm1z_5T3twGQw May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:27:18.361527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_10ec56d48dd54e36b1607f30ff55edca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: cdf7dc6769bb49ae9491c31cf289c90a May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Volume b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 could not be found. May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8'} May 16 15:27:18.363051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 could not be found. (HTTP 404) (Request-ID: req-1a0c3e0b-9fec-40fc-870a-1822ca2d19d4) May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.364876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:27:18.366055 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 could not be found. May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:27:18.367226 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 could not be found. May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 could not be found. May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11e0fc20-0248-4809-8a91-4340a4f5f1ca tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Returning 404 to user: Volume b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-11e0fc20-0248-4809-8a91-4340a4f5f1ca tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8" status: 404 len: 109 microversion: 2.1 time: 0.033875 May 16 15:27:18.368962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 389/775] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:27:18 2022] DELETE /compute/v2.1/os-volumes/b93f8b91-5be9-4fb2-b05d-4f37bf32d2c8 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:18.373925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8b82c14e-ee10-4377-aa3a-8bb6fcc58ea6 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Calling method '.version_select at 0x7fddb3c40550>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:18.400573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-8b82c14e-ee10-4377-aa3a-8bb6fcc58ea6 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] HTTP exception thrown: Volume 0f15c351-322f-4843-96ca-f5b3b1b3efe2 could not be found. May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8b82c14e-ee10-4377-aa3a-8bb6fcc58ea6 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Request method failure captured: May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/os-volumes/0f15c351-322f-4843-96ca-f5b3b1b3efe2 HTTP/1.1 May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm1W1ugwIBs6QPFTSnLI2Mtaezwc4jAFlcbDQYKpRe5RR_TCp4Kuo4iMIBFliVYt5_ar_Betq6_C1iuiKpEuJjJoczbXbK6n3mqUu21VIF_Shcg-pTMOzka4-rVNl67TOqbDXA_CpSwB_1HixTtZMP7gl_LBDa_5cnDm1z_5T3twGQw May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:27:18.402520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_10ec56d48dd54e36b1607f30ff55edca", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/10ec56d48dd54e36b1607f30ff55edca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 10ec56d48dd54e36b1607f30ff55edca May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesNegativeTest-14783231 May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: cdf7dc6769bb49ae9491c31cf289c90a May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesNegativeTest-14783231-project May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Volume 0f15c351-322f-4843-96ca-f5b3b1b3efe2 could not be found. May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '0f15c351-322f-4843-96ca-f5b3b1b3efe2'} May 16 15:27:18.404047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f15c351-322f-4843-96ca-f5b3b1b3efe2 could not be found. (HTTP 404) (Request-ID: req-f5ed19ac-7de1-457b-b3be-e75bab5ffac6) May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.405012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:27:18.406428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f15c351-322f-4843-96ca-f5b3b1b3efe2 could not be found. May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:27:18.407807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f15c351-322f-4843-96ca-f5b3b1b3efe2 could not be found. May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f15c351-322f-4843-96ca-f5b3b1b3efe2 could not be found. May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8b82c14e-ee10-4377-aa3a-8bb6fcc58ea6 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] Returning 404 to user: Volume 0f15c351-322f-4843-96ca-f5b3b1b3efe2 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8b82c14e-ee10-4377-aa3a-8bb6fcc58ea6 tempest-VolumesNegativeTest-14783231 tempest-VolumesNegativeTest-14783231-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/0f15c351-322f-4843-96ca-f5b3b1b3efe2" status: 404 len: 109 microversion: 2.1 time: 0.034219 May 16 15:27:18.409217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 387/776] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:27:18 2022] GET /compute/v2.1/os-volumes/0f15c351-322f-4843-96ca-f5b3b1b3efe2 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:18.741095 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8c7375f1-b414-415e-9bec-0107621845b1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:18.742217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8c7375f1-b414-415e-9bec-0107621845b1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:18.749268 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c7375f1-b414-415e-9bec-0107621845b1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:18.749827 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c7375f1-b414-415e-9bec-0107621845b1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:18.750635 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c7375f1-b414-415e-9bec-0107621845b1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:18.751070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8c7375f1-b414-415e-9bec-0107621845b1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:18.779698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8c7375f1-b414-415e-9bec-0107621845b1 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043360 May 16 15:27:18.784553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 390/777] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:27:18 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:27:18.791585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:18.792084 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:18.797934 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:18.798410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:18.799347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:18.799779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:18.872438 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] HTTP exception thrown: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc is not attached to volume c64a1af1-98a3-48e9-b5f4-17e433c98d21 May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Request method failure captured: May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments/c64a1af1-98a3-48e9-b5f4-17e433c98d21 HTTP/1.1 May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmyleUacVVn1UR4ivqAdAPeFojNOJ5Os18sEdIaFvGvPW6J7wiRxm_45eZV_-2KxeBWrQH2uzkkaK4bqNg7u6IvVTAqQaZYb2Gr1uSAMPShE7pZfDHSg_PGvl4-d6aZ-LMB7iL7J9YkW3rh6Fok8b1ULTr23fGaD1RXmllI9SFG_0XE May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 65e5f9f015814278b1062e2d7d681cc5 May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestMinimumBasicScenario-1061648835 May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:27:18.880074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/65e5f9f015814278b1062e2d7d681cc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_65e5f9f015814278b1062e2d7d681cc5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/65e5f9f015814278b1062e2d7d681cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/65e5f9f015814278b1062e2d7d681cc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestMinimumBasicScenario-1061648835 May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 65e5f9f015814278b1062e2d7d681cc5 May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1061648835 May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-TestMinimumBasicScenario-1061648835-project May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 816ac740698548b1b25826fe5168a62a May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestMinimumBasicScenario-1061648835-project May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:27:18.881876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc is not attached to volume c64a1af1-98a3-48e9-b5f4-17e433c98d21 May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '5887d24b-6885-49f4-99d0-7f99f99536cc', 'id': 'c64a1af1-98a3-48e9-b5f4-17e433c98d21'} May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c64a1af1-98a3-48e9-b5f4-17e433c98d21. May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:18.882750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc is not attached to volume c64a1af1-98a3-48e9-b5f4-17e433c98d21 May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc is not attached to volume c64a1af1-98a3-48e9-b5f4-17e433c98d21 May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:18.884090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Returning 404 to user: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc is not attached to volume c64a1af1-98a3-48e9-b5f4-17e433c98d21 {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:18.885152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6b0119ab-5a1a-4974-bebb-d2cf769ca78f tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments/c64a1af1-98a3-48e9-b5f4-17e433c98d21" status: 404 len: 154 microversion: 2.1 time: 0.096512 May 16 15:27:18.885152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 388/778] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:27:18 2022] DELETE /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc/os-volume_attachments/c64a1af1-98a3-48e9-b5f4-17e433c98d21 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:27:20.168510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:20.174808 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:20.175553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:20.175712 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:20.176490 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:20.176928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:20.202103 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:27:20.464977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2f3aaa64-f044-4c7c-9544-d92ad2e23812 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 204 len: 0 microversion: 2.1 time: 0.300491 May 16 15:27:20.465606 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 391/779] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:27:20 2022] DELETE /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:27:20.473754 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:20.474413 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:20.481552 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:20.482000 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:20.482799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:20.483233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:20.612590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:20.620072 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dd46f00f-3bc3-461f-8c7c-d8555e9fd55b tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1554 microversion: 2.1 time: 0.150143 May 16 15:27:20.620636 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 389/780] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:20 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:21.639278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:21.640228 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:21.646844 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:21.647299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:21.648082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:21.648519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:21.794561 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:21.804140 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7de0a097-3412-4161-b1a4-537742d41788 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1554 microversion: 2.1 time: 0.170270 May 16 15:27:21.804721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 392/781] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:21 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:22.825668 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:22.826403 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:22.832645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:22.833099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:22.833871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:22.834348 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:23.007393 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-aa44575c-1aa2-49e7-8d0a-fc7429c2327a req-c2645981-8a94-468c-aa04-7205d8204d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5887d24b-6885-49f4-99d0-7f99f99536cc", "name": "network-vif-deleted", "tag": "7f2dac2d-8507-4083-81bf-4f66b2f74796"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:23.015715 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-aa44575c-1aa2-49e7-8d0a-fc7429c2327a req-c2645981-8a94-468c-aa04-7205d8204d66 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:23.016165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-aa44575c-1aa2-49e7-8d0a-fc7429c2327a req-c2645981-8a94-468c-aa04-7205d8204d66 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:23.027193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-aa44575c-1aa2-49e7-8d0a-fc7429c2327a req-c2645981-8a94-468c-aa04-7205d8204d66 service nova] Creating event network-vif-deleted:7f2dac2d-8507-4083-81bf-4f66b2f74796 for instance 5887d24b-6885-49f4-99d0-7f99f99536cc on hv-cinder-79053 May 16 15:27:23.031113 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ac740698548b1b25826fe5168a62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e5f9f015814278b1062e2d7d681cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:23.032471 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-aa44575c-1aa2-49e7-8d0a-fc7429c2327a req-c2645981-8a94-468c-aa04-7205d8204d66 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029216 May 16 15:27:23.033387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 393/782] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:27:23.038785 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-629af9a7-60ff-4baa-9ea6-5c124ca405f5 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 200 len: 1554 microversion: 2.1 time: 0.217866 May 16 15:27:23.048914 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 390/783] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:22 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:23.875446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-180f8db9-d187-428a-9b70-ce9954d9443a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:23.876032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-180f8db9-d187-428a-9b70-ce9954d9443a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:23.882665 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-180f8db9-d187-428a-9b70-ce9954d9443a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:23.883127 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-180f8db9-d187-428a-9b70-ce9954d9443a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:23.883919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-180f8db9-d187-428a-9b70-ce9954d9443a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:23.884860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-180f8db9-d187-428a-9b70-ce9954d9443a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:23.910728 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-180f8db9-d187-428a-9b70-ce9954d9443a tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/ips" status: 200 len: 146 microversion: 2.1 time: 0.039496 May 16 15:27:23.911302 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 394/784] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:27:23 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:24.056827 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:24.057443 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] [instance: 5887d24b-6885-49f4-99d0-7f99f99536cc] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:24.063726 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:24.064175 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:24.064928 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:24.065358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:24.079346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] HTTP exception thrown: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc could not be found. May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Request method failure captured: May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc HTTP/1.1 May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmyleUacVVn1UR4ivqAdAPeFojNOJ5Os18sEdIaFvGvPW6J7wiRxm_45eZV_-2KxeBWrQH2uzkkaK4bqNg7u6IvVTAqQaZYb2Gr1uSAMPShE7pZfDHSg_PGvl4-d6aZ-LMB7iL7J9YkW3rh6Fok8b1ULTr23fGaD1RXmllI9SFG_0XE May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 65e5f9f015814278b1062e2d7d681cc5 May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestMinimumBasicScenario-1061648835 May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:27:24.081158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/65e5f9f015814278b1062e2d7d681cc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_65e5f9f015814278b1062e2d7d681cc5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/65e5f9f015814278b1062e2d7d681cc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/65e5f9f015814278b1062e2d7d681cc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestMinimumBasicScenario-1061648835 May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 65e5f9f015814278b1062e2d7d681cc5 May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1061648835 May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-TestMinimumBasicScenario-1061648835-project May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 816ac740698548b1b25826fe5168a62a May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestMinimumBasicScenario-1061648835-project May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc could not be found. May 16 15:27:24.082442 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '5887d24b-6885-49f4-99d0-7f99f99536cc'} May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc could not be found. May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:24.086686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc could not be found. May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc could not be found. May 16 15:27:24.088139 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:24.089420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Returning 404 to user: Instance 5887d24b-6885-49f4-99d0-7f99f99536cc could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:24.089420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-56eb8cb6-02eb-4347-b087-e20c9bfb60c9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc" status: 404 len: 111 microversion: 2.1 time: 0.029841 May 16 15:27:24.089420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 391/785] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:24 2022] GET /compute/v2.1/servers/5887d24b-6885-49f4-99d0-7f99f99536cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:24.099718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fff302a3-c2d3-41bd-9ff9-a3baf70d10a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] Calling method '.version_select at 0x7fddb3dd9f70>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:24.206559 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fff302a3-c2d3-41bd-9ff9-a3baf70d10a9 tempest-TestMinimumBasicScenario-1061648835 tempest-TestMinimumBasicScenario-1061648835-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1074292840" status: 202 len: 0 microversion: 2.1 time: 0.115592 May 16 15:27:24.207519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 395/786] 10.222.0.76 () {58 vars in 1271 bytes} [Mon May 16 15:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1074292840 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:25.566568 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5b39f6c6-c064-468b-80d8-3188a1d26aa4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75534fae-0f3d-4665-b81e-1f6f7b113332"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:25.567693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5b39f6c6-c064-468b-80d8-3188a1d26aa4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:25.581868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b39f6c6-c064-468b-80d8-3188a1d26aa4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:25.581868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b39f6c6-c064-468b-80d8-3188a1d26aa4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:25.581868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b39f6c6-c064-468b-80d8-3188a1d26aa4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:25.581868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b39f6c6-c064-468b-80d8-3188a1d26aa4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:26.251474 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5b39f6c6-c064-468b-80d8-3188a1d26aa4 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688863 May 16 15:27:26.252205 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 392/787] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:27:25 2022] POST /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:31.295058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9362ea54-f4db-4495-b3cf-1f6a8c3ee287 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:31.296384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9362ea54-f4db-4495-b3cf-1f6a8c3ee287 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:31.303476 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9362ea54-f4db-4495-b3cf-1f6a8c3ee287 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:31.304250 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9362ea54-f4db-4495-b3cf-1f6a8c3ee287 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:31.305252 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9362ea54-f4db-4495-b3cf-1f6a8c3ee287 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:31.305920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9362ea54-f4db-4495-b3cf-1f6a8c3ee287 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:31.331482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9362ea54-f4db-4495-b3cf-1f6a8c3ee287 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/ips" status: 200 len: 151 microversion: 2.20 time: 0.040487 May 16 15:27:31.332324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 396/788] 10.222.0.76 () {60 vars in 1288 bytes} [Mon May 16 15:27:31 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:27:33.582042 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:33.584068 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:33.591616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:33.592623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:33.600289 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:33.600289 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:33.620942 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lazy-loading 'flavor' on Instance uuid 1a3d7e6a-43dc-42b0-a663-56ad894c3801 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:27:33.804736 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-62999261-120f-41f1-b6cc-b1d249f42ef2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:33.805692 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-62999261-120f-41f1-b6cc-b1d249f42ef2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:33.814224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62999261-120f-41f1-b6cc-b1d249f42ef2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:33.814673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62999261-120f-41f1-b6cc-b1d249f42ef2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:33.815488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62999261-120f-41f1-b6cc-b1d249f42ef2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:33.815953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62999261-120f-41f1-b6cc-b1d249f42ef2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:33.844784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-62999261-120f-41f1-b6cc-b1d249f42ef2 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 May 16 15:27:33.845339 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 397/789] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:27:33 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:27:33.855478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-12198782-8ece-4e25-a3d6-9ea8a480df7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:33.855964 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-12198782-8ece-4e25-a3d6-9ea8a480df7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:33.861690 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12198782-8ece-4e25-a3d6-9ea8a480df7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:33.862202 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12198782-8ece-4e25-a3d6-9ea8a480df7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:33.862921 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12198782-8ece-4e25-a3d6-9ea8a480df7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:33.863341 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12198782-8ece-4e25-a3d6-9ea8a480df7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:33.891998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-12198782-8ece-4e25-a3d6-9ea8a480df7e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/75534fae-0f3d-4665-b81e-1f6f7b113332" status: 200 len: 194 microversion: 2.1 time: 0.040758 May 16 15:27:33.892564 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 398/790] 10.222.0.76 () {58 vars in 1412 bytes} [Mon May 16 15:27:33 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/75534fae-0f3d-4665-b81e-1f6f7b113332 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:27:34.387901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-58739b70-dec6-4723-ba41-d19a08049e09 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/action" status: 202 len: 0 microversion: 2.20 time: 0.810594 May 16 15:27:34.388659 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 393/791] 10.222.0.76 () {62 vars in 1318 bytes} [Mon May 16 15:27:33 2022] POST /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/action => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:27:34.396774 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:34.398042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:34.407176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:34.407633 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:34.408424 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:34.408869 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:34.602372 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:34.610783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:34.612315 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:34.613498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8f36fd0a-d0fa-411c-8830-b1e02ea95f28 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.220852 May 16 15:27:34.614309 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 399/792] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:34 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:27:35.612769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-74aad7dd-9e64-4673-a5f3-22531842edd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d91be15e-9f7f-4cfe-be8c-86b3c6badf1b"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:35.614064 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-74aad7dd-9e64-4673-a5f3-22531842edd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:35.621270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74aad7dd-9e64-4673-a5f3-22531842edd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:35.621714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74aad7dd-9e64-4673-a5f3-22531842edd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:35.623050 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74aad7dd-9e64-4673-a5f3-22531842edd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:35.623491 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-74aad7dd-9e64-4673-a5f3-22531842edd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:35.632839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:35.633696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:35.642139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:35.642831 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:35.644097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:35.645006 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:35.788054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:35.796667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:35.798174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:35.799377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-096ebe60-a981-4406-9089-094fe7d9df23 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.170727 May 16 15:27:35.800063 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 400/793] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:35 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:36.654115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-74aad7dd-9e64-4673-a5f3-22531842edd6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "POST /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045869 May 16 15:27:36.659970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 394/794] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:27:35 2022] POST /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments => generated 194 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:27:36.818346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:36.819192 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:36.826586 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:36.827112 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:36.827981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:36.828507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:36.978269 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:36.986256 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:36.987742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:36.988903 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-54e9ddec-4169-4055-ba60-24f92528be5c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.174418 May 16 15:27:36.989451 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 401/795] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:36 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:38.008550 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:38.009240 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:38.015406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:38.015856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:38.016617 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:38.017051 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:38.157879 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:38.166151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:38.168564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:38.169814 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8b445132-6a56-400f-9fb4-6773620deedb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.166198 May 16 15:27:38.170382 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 395/796] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:38 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:39.188819 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:39.189427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:39.195716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:39.201955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:39.201955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:39.201955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:39.381065 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:39.389777 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:39.391551 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:39.392714 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6f39a57d-8d30-4da1-b4d9-937d7ad28c1a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.207839 May 16 15:27:39.393270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 402/797] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:39 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:40.410715 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:40.411384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:40.424769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:40.425492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:40.426509 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:40.426942 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:40.568895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:40.581430 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:40.584009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:40.585533 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d3125de8-e567-4cf2-b06f-509b242edefa tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.178668 May 16 15:27:40.586783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 396/798] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:40 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:41.064019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:41.064519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:41.076346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.077223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:41.078259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.078919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:41.105992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lazy-loading 'flavor' on Instance uuid 26e9b501-f7d9-4696-a6c2-c1930221431a {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:27:41.434710 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ca9054ea-45f4-4484-8c9a-58095a375f30 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "POST /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a/action" status: 202 len: 0 microversion: 2.1 time: 0.375386 May 16 15:27:41.438253 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 403/799] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:27:41 2022] POST /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:41.447563 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:41.448859 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:41.458982 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.459729 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:41.462545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.463927 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:41.606464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:41.607178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:41.618645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.622450 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:41.623088 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:41.623997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:41.720860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:41.730964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f166f87c-606a-4056-9514-422b5d86e8f7 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.288533 May 16 15:27:41.732334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 397/800] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:41 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:41.880052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:41.891012 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:41.892838 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:41.894377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ec42d39f-d1b9-4165-9050-d6bb87abd15f tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.294001 May 16 15:27:41.897143 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 404/801] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:41 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:42.749434 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:42.750040 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:42.759446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:42.759446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:42.759446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:42.759446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:42.912723 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:42.913528 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:42.921799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:42.927486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:42.927486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:42.927486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:42.938694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:42.946539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f68219e2-f203-4e76-b72f-1a1f0614c7dc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.201595 May 16 15:27:42.947243 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 398/802] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:42 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:43.069499 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:43.101232 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:43.103686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:43.105920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-796474a8-6cd6-460e-8df8-fe84e9047d7a tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.196714 May 16 15:27:43.118306 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 405/803] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:42 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:27:43.970780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:43.971414 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:43.977880 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:43.978401 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:43.979201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:43.980163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.124561 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:44.126782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:44.137821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.139667 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.143525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.144134 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.150111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:44.178044 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b808deb6-b2d1-4c8d-8a26-4ca8f23a77d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.217846 May 16 15:27:44.190419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 399/804] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:43 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:44.276664 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f1ea9dda-14ae-47a5-969b-d47f73ff0b84 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:44.277847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f1ea9dda-14ae-47a5-969b-d47f73ff0b84 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:44.284648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1ea9dda-14ae-47a5-969b-d47f73ff0b84 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.285353 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1ea9dda-14ae-47a5-969b-d47f73ff0b84 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.286175 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1ea9dda-14ae-47a5-969b-d47f73ff0b84 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.286615 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f1ea9dda-14ae-47a5-969b-d47f73ff0b84 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.321172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f1ea9dda-14ae-47a5-969b-d47f73ff0b84 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051045 May 16 15:27:44.322378 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 400/805] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:27:44 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:27:44.438768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:44.448450 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:44.450414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:44.451892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d2d362a-ddfc-4a88-8b54-157f3b06d3d0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.331730 May 16 15:27:44.453022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 406/806] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:44 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:44.465952 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1ca04f92-a27f-4e09-a97e-115e1bc06496 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:44.466491 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1ca04f92-a27f-4e09-a97e-115e1bc06496 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:44.473074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ca04f92-a27f-4e09-a97e-115e1bc06496 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.473833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ca04f92-a27f-4e09-a97e-115e1bc06496 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.474967 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ca04f92-a27f-4e09-a97e-115e1bc06496 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.475574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ca04f92-a27f-4e09-a97e-115e1bc06496 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.509115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1ca04f92-a27f-4e09-a97e-115e1bc06496 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/75534fae-0f3d-4665-b81e-1f6f7b113332" status: 200 len: 194 microversion: 2.1 time: 0.048313 May 16 15:27:44.509731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 401/807] 10.222.0.76 () {58 vars in 1412 bytes} [Mon May 16 15:27:44 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/75534fae-0f3d-4665-b81e-1f6f7b113332 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:44.519803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:44.520396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:44.527332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.527867 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.528716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:44.529235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:44.614516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lazy-loading 'services' on Instance uuid 263af909-b095-4188-82a6-8f6da66d0e96 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:27:44.870981 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c22309ca-f0c8-444c-bf7b-2029cd6a737f tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/75534fae-0f3d-4665-b81e-1f6f7b113332" status: 202 len: 0 microversion: 2.1 time: 0.355328 May 16 15:27:44.879209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 407/808] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:27:44 2022] DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/75534fae-0f3d-4665-b81e-1f6f7b113332 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:45.199357 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:45.200041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:45.206656 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:45.207034 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:45.207805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:45.208233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:45.469130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:45.471992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:45.473800 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:45.477499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9c333cae-b061-445c-a028-d2c0736ada8c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.284349 May 16 15:27:45.478074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 402/809] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:45 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:45.488201 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:45.488909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:45.489599 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:45.490034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:45.724640 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:45.741988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:45.744128 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:45.746447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-eb0cadf2-8102-40ee-9370-87283edbc6fb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1744 microversion: 2.20 time: 0.279356 May 16 15:27:45.747776 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 408/810] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:45 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1744 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:46.225903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-58c5b183-b5b9-458a-85d0-a59375344759 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:46.226470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-58c5b183-b5b9-458a-85d0-a59375344759 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:46.235299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58c5b183-b5b9-458a-85d0-a59375344759 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.236838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58c5b183-b5b9-458a-85d0-a59375344759 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.237769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58c5b183-b5b9-458a-85d0-a59375344759 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.238226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-58c5b183-b5b9-458a-85d0-a59375344759 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.280275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-58c5b183-b5b9-458a-85d0-a59375344759 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/d91be15e-9f7f-4cfe-be8c-86b3c6badf1b" status: 200 len: 194 microversion: 2.1 time: 0.058276 May 16 15:27:46.287263 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 403/811] 10.222.0.76 () {58 vars in 1412 bytes} [Mon May 16 15:27:46 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/d91be15e-9f7f-4cfe-be8c-86b3c6badf1b => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:46.291265 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:46.292068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:46.301445 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.311501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.311501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.311501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.466280 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lazy-loading 'services' on Instance uuid 263af909-b095-4188-82a6-8f6da66d0e96 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:27:46.496103 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:46.496889 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:46.507764 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.510324 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.511427 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.514538 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.701172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:46.718274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4325dceb-9d57-4c76-95e5-faaf404bbea0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.227001 May 16 15:27:46.728424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 404/812] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:46 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:46.767347 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:46.768250 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:46.777604 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.778373 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.779435 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:46.780173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:46.813341 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ed3947a1-0e71-4ab0-a0cf-d0986d3d6e2e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/d91be15e-9f7f-4cfe-be8c-86b3c6badf1b" status: 202 len: 0 microversion: 2.1 time: 0.525760 May 16 15:27:46.817724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 409/813] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:27:46 2022] DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments/d91be15e-9f7f-4cfe-be8c-86b3c6badf1b => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:47.151868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:47.160795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:47.162350 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:47.163598 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-88f163b0-229b-421e-9905-dd56d3701713 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1744 microversion: 2.20 time: 0.400190 May 16 15:27:47.164166 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 405/814] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:46 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1744 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:47.747401 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:47.747401 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:47.774520 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:47.774970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:47.776029 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:47.777845 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:48.175631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:48.186612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:48.197077 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:48.213285 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bc303b2c-af8e-468c-82b8-0827240e2712 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.479791 May 16 15:27:48.217287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 410/815] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:47 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:48.217844 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:48.218545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:48.219552 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:48.220224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:48.386734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:48.398454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:48.401138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:48.403300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-84ab532d-3d5e-4169-885c-d2447b4af9a3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.224792 May 16 15:27:48.408035 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 406/816] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:48 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:27:49.233425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:49.236794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:49.259080 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.259560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.260394 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.260841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.468512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e4fb0902-e67c-4dec-baf7-1b2b7dc8247f req-10494799-e3a2-4e41-8021-df7b00503332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3d7e6a-43dc-42b0-a663-56ad894c3801", "name": "network-vif-plugged", "status": "completed", "tag": "588be31f-e001-4d2f-97c9-ef1bb2eeef86"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:49.483889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e4fb0902-e67c-4dec-baf7-1b2b7dc8247f req-10494799-e3a2-4e41-8021-df7b00503332 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.486292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e4fb0902-e67c-4dec-baf7-1b2b7dc8247f req-10494799-e3a2-4e41-8021-df7b00503332 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.515312 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e4fb0902-e67c-4dec-baf7-1b2b7dc8247f req-10494799-e3a2-4e41-8021-df7b00503332 service nova] Creating event network-vif-plugged:588be31f-e001-4d2f-97c9-ef1bb2eeef86 for instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 on hv-cinder-79053 May 16 15:27:49.528625 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e4fb0902-e67c-4dec-baf7-1b2b7dc8247f req-10494799-e3a2-4e41-8021-df7b00503332 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409556 May 16 15:27:49.532150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:49.532469 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 411/817] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:49.540627 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-284804a2-175f-44c5-b115-effb09b07837 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.312898 May 16 15:27:49.543163 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-771226ed-9383-42e2-8c87-dcd26f3cbbc8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:49.548089 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-771226ed-9383-42e2-8c87-dcd26f3cbbc8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:49.555886 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 407/818] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:49 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:49.562083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-771226ed-9383-42e2-8c87-dcd26f3cbbc8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.567409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-771226ed-9383-42e2-8c87-dcd26f3cbbc8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.568528 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-771226ed-9383-42e2-8c87-dcd26f3cbbc8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.569192 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-771226ed-9383-42e2-8c87-dcd26f3cbbc8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.571378 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:49.572016 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:49.578211 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.578881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.582470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.583094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.623352 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-771226ed-9383-42e2-8c87-dcd26f3cbbc8 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089346 May 16 15:27:49.624559 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 412/819] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:27:49 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:27:49.854718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1837c711-d66d-4050-8500-a963de1994f0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:49.854718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1837c711-d66d-4050-8500-a963de1994f0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:49.868421 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1837c711-d66d-4050-8500-a963de1994f0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.871516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1837c711-d66d-4050-8500-a963de1994f0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.874884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1837c711-d66d-4050-8500-a963de1994f0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:49.875564 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1837c711-d66d-4050-8500-a963de1994f0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:49.941695 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1837c711-d66d-4050-8500-a963de1994f0 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097890 May 16 15:27:49.942762 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 413/820] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:27:49 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:27:49.988096 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:50.007322 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:50.009855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:50.017239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-72ca5c3a-ae81-49f0-8c62-85e4a7bc2c06 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.455171 May 16 15:27:50.018579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 408/821] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:49 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:50.071659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:50.072448 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:50.080619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.081431 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.082527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.083166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.147290 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:27:50.561976 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:50.563635 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:50.579692 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.580159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.581064 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.581510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.620223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-72db4552-2c43-4aa5-9ea8-ffad76f5e282 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 204 len: 0 microversion: 2.1 time: 0.559047 May 16 15:27:50.621409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 414/822] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:27:50 2022] DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:27:50.643625 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:50.644673 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:50.662721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.663208 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.664128 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:50.664592 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:50.810313 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:50.823220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ba3caf00-1d32-4927-9c15-ee22ac8529bb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.268825 May 16 15:27:50.824544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 409/823] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:50 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:50.940351 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:50.949606 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e7653914-f56d-47cb-8201-068d2ba18041 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1673 microversion: 2.1 time: 0.323450 May 16 15:27:50.961475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 415/824] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:50 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1673 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:51.036378 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:51.037007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:51.057901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.063231 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:51.064339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.066557 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:51.288837 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:51.298774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:51.300842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:51.302520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-094eabfd-13f0-4d68-912a-bbd6c8ef8a7c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.270759 May 16 15:27:51.303251 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 410/825] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:51 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:51.722420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-19a97037-c7f9-4974-a856-e34488bd1df9 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Action: 'create', calling method: .version_select at 0x7fddb3e2aa60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-88033795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4hNTZMq+ilgB8XowGXubxIhmYphSogXlVxuIMWPlVODr4SjP1fTbsGDoqMtHoa6Hdj2E4FJ0FhU/7uUwC61lSxROv3CpX2y/ts4PfRp+2Hrtc3S9r/r7emt1Dnz5eLkA=="}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:51.748956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-19a97037-c7f9-4974-a856-e34488bd1df9 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for project bc74c97613c4462bb551e50800a5f5e2. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:27:51.752899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-19a97037-c7f9-4974-a856-e34488bd1df9 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for user e916a70861fc44e69160faf793999f6d and project bc74c97613c4462bb551e50800a5f5e2. Resources: {'key_pairs'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:27:51.841310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:51.841916 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:51.853116 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.854294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:51.855342 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.855935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:51.856211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-19a97037-c7f9-4974-a856-e34488bd1df9 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.283841 May 16 15:27:51.858502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 416/826] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:27:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:51.969489 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:51.970100 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:51.980145 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.980602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:51.981393 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:51.982081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.118018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:52.129860 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9c76e12c-ff08-4f51-8a02-055664f282fc tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.292634 May 16 15:27:52.130813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 411/827] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:51 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:52.172992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:52.186460 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dc8ee0d8-2ab3-4bfb-b90c-a9369a403ef3 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1673 microversion: 2.1 time: 0.221781 May 16 15:27:52.197753 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 417/828] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:51 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:52.323189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:52.323849 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:52.335597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.336081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:52.337466 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:52.338613 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:53.037525 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:53.050574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:53.052820 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:53.056801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-baeebc7c-a8d2-4429-a4b1-939b95a85861 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.738186 May 16 15:27:53.066094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 412/829] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:52 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:53.148333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:53.150005 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:53.165262 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:53.166360 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:53.167663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:53.168332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:53.206831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:53.207608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:53.216054 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:53.216611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:53.217550 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:53.218100 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:53.380614 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:53.389730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4969149b-5c86-4edc-a084-f2605563db0d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.245413 May 16 15:27:53.390348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 418/830] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:53 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:53.689224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:53.703728 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3d90efaf-3a9e-4da0-b991-e643d417156e tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1673 microversion: 2.1 time: 0.495785 May 16 15:27:53.704372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 413/831] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:53 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1673 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:54.081022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:54.081838 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:54.098221 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.099003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.100656 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.101294 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.405585 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:54.407763 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:54.408372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:54.424122 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:54.430559 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:54.432568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-087c8ee3-246e-4aac-9bfe-65808c0fa896 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.359787 May 16 15:27:54.434383 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 419/832] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:54 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:54.440911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.443080 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.445047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.447021 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.518706 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-5b004a32-aa92-4ddd-8fe6-66046c8182ed req-7a4ce86a-92ab-41cf-8c9a-b809890fcfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "263af909-b095-4188-82a6-8f6da66d0e96", "name": "network-vif-deleted", "tag": "7e202561-b4bc-4d1f-98b5-3234f4c66c40"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:54.542623 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5b004a32-aa92-4ddd-8fe6-66046c8182ed req-7a4ce86a-92ab-41cf-8c9a-b809890fcfd4 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.543506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-5b004a32-aa92-4ddd-8fe6-66046c8182ed req-7a4ce86a-92ab-41cf-8c9a-b809890fcfd4 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.571381 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-5b004a32-aa92-4ddd-8fe6-66046c8182ed req-7a4ce86a-92ab-41cf-8c9a-b809890fcfd4 service nova] Creating event network-vif-deleted:7e202561-b4bc-4d1f-98b5-3234f4c66c40 for instance 263af909-b095-4188-82a6-8f6da66d0e96 on hv-cinder-79053 May 16 15:27:54.580292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-5b004a32-aa92-4ddd-8fe6-66046c8182ed req-7a4ce86a-92ab-41cf-8c9a-b809890fcfd4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065619 May 16 15:27:54.581686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 420/833] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:54.682538 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:54.704248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0b677308-a3c2-40b4-87f9-f90a352878bd tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.300439 May 16 15:27:54.705126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 414/834] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:54 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:27:54.723465 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:54.724292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:54.737435 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.738071 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.738987 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:54.740155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:54.870342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:54.882442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-09ffd45e-6ab9-40f5-a2a3-a4fd0ca8842d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1606 microversion: 2.1 time: 0.163406 May 16 15:27:54.884918 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 421/835] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:54 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1606 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:55.456771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:55.459397 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:55.476292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.478416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.481911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.482705 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.722688 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:55.724087 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:55.737160 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.749152 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.751016 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.752417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.934032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:55.943005 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:55.946909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:55.946909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5e16833e-7947-40cf-bb32-75ca6b8b2a2e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.497969 May 16 15:27:55.956640 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 415/836] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:55 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:55.961705 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:55.962379 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:55.990545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.991013 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:55.991834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:55.992269 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:56.085959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:56.089073 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:56.090172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lazy-loading 'fault' on Instance uuid 263af909-b095-4188-82a6-8f6da66d0e96 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:27:56.131678 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:56.147507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-16a6ab8a-2162-4d5d-936f-196420e53297 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.427503 May 16 15:27:56.147507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 422/837] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:55 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:56.178235 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b16118d74774a9ea673d6e0532b8772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b360d85257f14f9191b490327c110ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:56.183785 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-356dbf7f-a3aa-4cc9-990b-f24b50cc1c55 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 200 len: 1327 microversion: 2.1 time: 0.225779 May 16 15:27:56.184873 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 416/838] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:55 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 1327 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:56.820464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e2debd45-d977-47fb-bd9d-02a595a3b2b1 req-075d8b55-ac2a-4a28-97ba-44505b0b8446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e9b501-f7d9-4696-a6c2-c1930221431a", "name": "network-vif-unplugged", "status": "completed", "tag": "63eb5f5f-0157-446b-b8eb-bc09b2fc4125"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:56.833635 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e2debd45-d977-47fb-bd9d-02a595a3b2b1 req-075d8b55-ac2a-4a28-97ba-44505b0b8446 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:56.834582 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e2debd45-d977-47fb-bd9d-02a595a3b2b1 req-075d8b55-ac2a-4a28-97ba-44505b0b8446 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:56.859152 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e2debd45-d977-47fb-bd9d-02a595a3b2b1 req-075d8b55-ac2a-4a28-97ba-44505b0b8446 service nova] Creating event network-vif-unplugged:63eb5f5f-0157-446b-b8eb-bc09b2fc4125 for instance 26e9b501-f7d9-4696-a6c2-c1930221431a on hv-cinder-79053 May 16 15:27:56.867247 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e2debd45-d977-47fb-bd9d-02a595a3b2b1 req-075d8b55-ac2a-4a28-97ba-44505b0b8446 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052026 May 16 15:27:56.867863 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 423/839] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:27:56.974608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:56.975150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:56.983856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:56.988887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:56.988887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:56.988887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.165864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:57.166704 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:57.179637 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.180443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.183121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.183734 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.250615 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:57.265083 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:57.267045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:57.269449 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-419bd166-265a-4033-8ef8-de2732235bda tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.299020 May 16 15:27:57.270546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 417/840] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:56 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:57.287451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:57.288802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:57.305392 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.306055 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.308648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.310390 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.328834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] HTTP exception thrown: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Request method failure captured: May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 HTTP/1.1 May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmv2Eye8ipk9c64_Y7BZgf1h9tjz8iHyyA11nUPEG13SCX6rABxVZ1_R_aJyaJQtxpw1_u52RFOPcrar_EJtBN_888kfMOPtciqiLq3FVtPzKE_IgE6AuuJVGDDU-SfD6qy_gyOOSHpfXz7YJJZHud1wIHgGqRWPiKOrJFPR3-96Vts May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: b360d85257f14f9191b490327c110ba8 May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:27:57.331536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b360d85257f14f9191b490327c110ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b360d85257f14f9191b490327c110ba8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-656783132 May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: b360d85257f14f9191b490327c110ba8 May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-656783132-project May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 6b16118d74774a9ea673d6e0532b8772 May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-656783132-project May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:27:57.343678 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '263af909-b095-4188-82a6-8f6da66d0e96'} May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:27:57.344448 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:27:57.345697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:27:57.348337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Returning 404 to user: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:27:57.348337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5dca1bfc-6eef-4ac6-a5f2-3a0bd2e8bdc6 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 404 len: 111 microversion: 2.1 time: 0.061563 May 16 15:27:57.348337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 418/841] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:57 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:27:57.359130 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a6d2fd73-4373-421c-a1e1-6bcff57c7a9d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '.version_select at 0x7fddb3ca9280>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:57.480356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a6d2fd73-4373-421c-a1e1-6bcff57c7a9d tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281445477" status: 202 len: 0 microversion: 2.1 time: 0.128820 May 16 15:27:57.480356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 419/842] 10.222.0.76 () {58 vars in 1220 bytes} [Mon May 16 15:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281445477 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:57.500107 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:57.515578 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ec814dc4-c2f5-4ca2-9d8a-f08a77736088 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1567 microversion: 2.1 time: 0.354914 May 16 15:27:57.529083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 424/843] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:57 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:57.538135 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8bb30d1d-131e-49d1-8d84-6d494f7c2001 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:27:57.539414 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8bb30d1d-131e-49d1-8d84-6d494f7c2001 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:57.565108 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8bb30d1d-131e-49d1-8d84-6d494f7c2001 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.571520 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8bb30d1d-131e-49d1-8d84-6d494f7c2001 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:57.575076 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8bb30d1d-131e-49d1-8d84-6d494f7c2001 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:57.575786 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8bb30d1d-131e-49d1-8d84-6d494f7c2001 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:58.022069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8bb30d1d-131e-49d1-8d84-6d494f7c2001 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "POST /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a/action" status: 202 len: 0 microversion: 2.1 time: 0.490643 May 16 15:27:58.025794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 420/844] 10.222.0.76 () {60 vars in 1277 bytes} [Mon May 16 15:27:57 2022] POST /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:27:58.033109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:58.034991 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:58.054512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:58.059498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:58.064820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:58.065495 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:58.291406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:58.292054 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:58.309590 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:58.312338 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:58.319257 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:58.320615 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-aa9839d8-7d43-4d16-8425-faf854418ddb tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1515 microversion: 2.1 time: 0.293434 May 16 15:27:58.321168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 425/845] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:58 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:58.331846 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:58.332321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:58.674843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:58.690890 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:58.710213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:58.712263 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-80f305ae-1d9d-40db-8934-8260bfd1c835 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.426111 May 16 15:27:58.728397 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 421/846] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:58 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:27:59.338754 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:59.339303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:59.346442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:59.346892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:59.347659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:59.348093 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:59.499210 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:59.507397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2b3de401-0428-4f75-a95f-bd3f25ef7263 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1515 microversion: 2.1 time: 0.172551 May 16 15:27:59.508252 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 426/847] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:27:59 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:27:59.736847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:27:59.738684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:27:59.749540 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:59.750026 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:59.751039 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:27:59.751549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:27:59.888125 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:59.896551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:59.898182 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:27:59.899384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5c3e34cf-a024-48bf-9afc-703f145b59e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.166697 May 16 15:27:59.899943 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 422/848] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:27:59 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:00.525243 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:00.526525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:00.535336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:00.536210 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:00.537094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:00.537761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:00.707713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:00.716998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-672943f4-3a76-4b18-9f3a-4c711e0c8c93 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1517 microversion: 2.1 time: 0.195705 May 16 15:28:00.717631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 427/849] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:00 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:00.919833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:00.923759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:00.939006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:00.939614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:00.940751 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:00.941264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.201040 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:01.210698 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:01.216922 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:01.216922 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b746f2ea-39f8-4224-8690-e69ed61fca00 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.302074 May 16 15:28:01.217159 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 423/850] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:00 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:01.552446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:01.553866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:01.566765 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.567574 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.568707 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.569344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.585570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] HTTP exception thrown: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Request method failure captured: May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 HTTP/1.1 May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv2Eye8ipk9c64_Y7BZgf1h9tjz8iHyyA11nUPEG13SCX6rABxVZ1_R_aJyaJQtxpw1_u52RFOPcrar_EJtBN_888kfMOPtciqiLq3FVtPzKE_IgE6AuuJVGDDU-SfD6qy_gyOOSHpfXz7YJJZHud1wIHgGqRWPiKOrJFPR3-96Vts May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:28:01.590603 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b360d85257f14f9191b490327c110ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b360d85257f14f9191b490327c110ba8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6b16118d74774a9ea673d6e0532b8772 May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.592652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '263af909-b095-4188-82a6-8f6da66d0e96'} May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:28:01.593609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.595235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:01.597019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Returning 404 to user: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:28:01.597019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8670a7d4-7ec4-4d17-8379-875908995760 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 404 len: 111 microversion: 2.1 time: 0.040843 May 16 15:28:01.597019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 428/851] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:28:01 2022] DELETE /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:28:01.605307 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:01.606287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: 263af909-b095-4188-82a6-8f6da66d0e96] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:01.612403 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.619376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.619376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.619376 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.629338 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] HTTP exception thrown: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Request method failure captured: May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 HTTP/1.1 May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmv2Eye8ipk9c64_Y7BZgf1h9tjz8iHyyA11nUPEG13SCX6rABxVZ1_R_aJyaJQtxpw1_u52RFOPcrar_EJtBN_888kfMOPtciqiLq3FVtPzKE_IgE6AuuJVGDDU-SfD6qy_gyOOSHpfXz7YJJZHud1wIHgGqRWPiKOrJFPR3-96Vts May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:28:01.631138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b360d85257f14f9191b490327c110ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b360d85257f14f9191b490327c110ba8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 6b16118d74774a9ea673d6e0532b8772 May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.632798 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '263af909-b095-4188-82a6-8f6da66d0e96'} May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:28:01.633979 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. May 16 15:28:01.635468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:01.637381 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Returning 404 to user: Instance 263af909-b095-4188-82a6-8f6da66d0e96 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:28:01.637381 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-03653f36-7e80-4960-a06e-43a2d1d24012 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96" status: 404 len: 111 microversion: 2.1 time: 0.038725 May 16 15:28:01.637381 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 424/852] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:01 2022] GET /compute/v2.1/servers/263af909-b095-4188-82a6-8f6da66d0e96 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:28:01.742398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:01.743432 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:01.750977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.751706 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.752557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:01.753049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:01.992323 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:02.000827 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5133b02d-bed6-4595-88d7-bf92edfcb89f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1517 microversion: 2.1 time: 0.262380 May 16 15:28:02.003060 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 429/853] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:01 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1517 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:02.239006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:02.240450 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:02.250926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:02.251387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:02.252707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:02.253163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:02.556937 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:02.568901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:02.573016 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:02.574796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0f378e27-813a-4e8c-b9b5-fe48ebcb0bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.340116 May 16 15:28:02.575794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 425/854] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:02 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:02.984016 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:02.985299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:02.992835 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:02.993286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:02.994336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:02.995158 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.011276 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] HTTP exception thrown: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Request method failure captured: May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 HTTP/1.1 May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv2Eye8ipk9c64_Y7BZgf1h9tjz8iHyyA11nUPEG13SCX6rABxVZ1_R_aJyaJQtxpw1_u52RFOPcrar_EJtBN_888kfMOPtciqiLq3FVtPzKE_IgE6AuuJVGDDU-SfD6qy_gyOOSHpfXz7YJJZHud1wIHgGqRWPiKOrJFPR3-96Vts May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:28:03.015456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b360d85257f14f9191b490327c110ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b360d85257f14f9191b490327c110ba8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6b16118d74774a9ea673d6e0532b8772 May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.016919 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'ca077d05-e39f-4ce2-ba17-bc13b0d34bb4'} May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:28:03.018239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.033502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.035572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Returning 404 to user: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:28:03.035572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a2f5eb31-416b-4dbf-9300-227221debced tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "DELETE /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 404 len: 111 microversion: 2.1 time: 0.034908 May 16 15:28:03.035572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 430/855] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:28:02 2022] DELETE /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:28:03.035832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:03.035832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:03.035832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.035832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.036180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.036180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.036362 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:03.036362 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] [instance: ca077d05-e39f-4ce2-ba17-bc13b0d34bb4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:03.043447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.044068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.045212 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.045788 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.063599 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] HTTP exception thrown: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Request method failure captured: May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 HTTP/1.1 May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv2Eye8ipk9c64_Y7BZgf1h9tjz8iHyyA11nUPEG13SCX6rABxVZ1_R_aJyaJQtxpw1_u52RFOPcrar_EJtBN_888kfMOPtciqiLq3FVtPzKE_IgE6AuuJVGDDU-SfD6qy_gyOOSHpfXz7YJJZHud1wIHgGqRWPiKOrJFPR3-96Vts May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:28:03.065441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b360d85257f14f9191b490327c110ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b360d85257f14f9191b490327c110ba8", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b360d85257f14f9191b490327c110ba8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: b360d85257f14f9191b490327c110ba8 May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656783132 May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 6b16118d74774a9ea673d6e0532b8772 May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeTestJSON-656783132-project May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.067079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'ca077d05-e39f-4ce2-ba17-bc13b0d34bb4'} May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:28:03.067970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. May 16 15:28:03.069449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:28:03.070803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] Returning 404 to user: Instance ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:28:03.071707 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3724528a-bb82-459a-a5fc-bebed8dabd98 tempest-AttachVolumeTestJSON-656783132 tempest-AttachVolumeTestJSON-656783132-project] 10.222.0.76 "GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4" status: 404 len: 111 microversion: 2.1 time: 0.041789 May 16 15:28:03.076729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 431/856] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:03 2022] GET /compute/v2.1/servers/ca077d05-e39f-4ce2-ba17-bc13b0d34bb4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:28:03.207962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:03.216611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db59c4e2-9d31-458b-a1b9-3829a6f9dce9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.200394 May 16 15:28:03.217405 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 426/857] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:03 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:03.593118 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:03.593742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:03.599767 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.600174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.600948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:03.601389 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:03.853406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:03.863551 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:03.866830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:03.871772 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a1160806-acac-4b91-bba5-0cbe9769c53b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.280103 May 16 15:28:03.885118 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 432/858] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:03 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:04.234757 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:04.236323 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:04.243387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:04.244193 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:04.245194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:04.246069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:04.423841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:04.432436 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9fd9dba2-53a2-4793-956e-0efe792a1f3d tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.201595 May 16 15:28:04.433309 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 427/859] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:04 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:04.893513 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:04.894197 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:04.901382 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:04.902160 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:04.903156 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:04.903786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:05.137418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:05.145189 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:05.146732 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:05.147907 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5c0b506e-af19-40ef-8ed7-cc4f14f5ffe3 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1739 microversion: 2.20 time: 0.258480 May 16 15:28:05.148466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 433/860] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:04 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:05.449543 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:05.450195 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:05.457212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:05.457674 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:05.458703 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:05.459244 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:05.776114 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:05.788266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fa1ffa80-e7db-4377-b3a2-8ab13e923d26 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.343014 May 16 15:28:05.789858 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 428/861] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:05 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:06.172703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:06.173309 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:06.179800 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:06.180244 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:06.181001 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:06.181428 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:06.439506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:06.447208 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:06.448717 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:06.451256 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-6a039a86-7594-43a1-a273-4676dd0bf383 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1721 microversion: 2.20 time: 0.282168 May 16 15:28:06.452195 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 434/862] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:06 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:28:06.805432 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:06.806641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:06.817810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:06.818296 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:06.819100 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:06.819546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:07.386278 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:07.396470 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c4a16d1a-f2e3-4c5d-8589-b8b93050c14e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.594831 May 16 15:28:07.397055 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 429/863] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:06 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:07.470963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:07.471580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:07.478328 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:07.479056 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:07.480048 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:07.480551 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:07.648373 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:07.656679 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:07.658268 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:07.659526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c21fa086-5e0c-4a5a-bd3b-c968b98e4021 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1721 microversion: 2.20 time: 0.192585 May 16 15:28:07.660307 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 435/864] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:07 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:08.413869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:08.414517 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:08.421896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:08.422515 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:08.423486 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:08.424027 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:08.555111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:08.562973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6318a844-b997-4be1-884e-d52ab18c03d0 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.152574 May 16 15:28:08.563539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 430/865] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:08 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:08.678529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:08.679081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:08.685571 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:08.686029 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:08.686837 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:08.687280 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:08.826180 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:08.833883 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:08.835422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:08.836580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bdde87f3-e146-4304-81c1-b13f3ca2210b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1721 microversion: 2.20 time: 0.162120 May 16 15:28:08.837130 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 436/866] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:08 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:09.161524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-19825541-8798-4ede-b104-667fe0b343e8 req-ae905eeb-287b-463e-9fc2-64727db8f7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3d7e6a-43dc-42b0-a663-56ad894c3801", "name": "network-vif-unplugged", "status": "completed", "tag": "588be31f-e001-4d2f-97c9-ef1bb2eeef86"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:09.169346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-19825541-8798-4ede-b104-667fe0b343e8 req-ae905eeb-287b-463e-9fc2-64727db8f7c3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:09.169796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-19825541-8798-4ede-b104-667fe0b343e8 req-ae905eeb-287b-463e-9fc2-64727db8f7c3 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:09.180449 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-19825541-8798-4ede-b104-667fe0b343e8 req-ae905eeb-287b-463e-9fc2-64727db8f7c3 service nova] Creating event network-vif-unplugged:588be31f-e001-4d2f-97c9-ef1bb2eeef86 for instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 on hv-cinder-79053 May 16 15:28:09.186017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-19825541-8798-4ede-b104-667fe0b343e8 req-ae905eeb-287b-463e-9fc2-64727db8f7c3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028361 May 16 15:28:09.186631 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 431/867] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:09.580364 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:09.581098 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:09.589397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:09.589626 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:09.590479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:09.590942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:09.750030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:09.764067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-02d44842-7251-4427-b9d9-542ceb9cb417 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.182998 May 16 15:28:09.764067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 437/868] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:09 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:09.856482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:09.857180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:09.863252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:09.863656 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:09.864424 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:09.864861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:10.007062 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:10.015009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:10.016500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:10.017718 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a47e1934-f177-4028-baea-b842dddf8696 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1721 microversion: 2.20 time: 0.166521 May 16 15:28:10.018259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 432/869] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:09 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:10.776959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:10.777565 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:10.783932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:10.784430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:10.785204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:10.785645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:10.916533 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:10.924428 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5164e8b9-5eae-4364-b4d5-19f2d1df6f0f tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.151558 May 16 15:28:10.925005 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 438/870] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:10 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:11.036392 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:11.036948 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:11.043919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:11.044375 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:11.045142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:11.045622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:11.178445 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:11.187794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:11.189300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:11.190494 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-433a98b9-7aad-4bda-9d83-3e88c38e2446 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1721 microversion: 2.20 time: 0.158098 May 16 15:28:11.191043 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 433/871] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:11 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:11.942061 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:11.942729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:11.957721 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:11.958193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:11.959023 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:11.959710 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:12.176449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:12.184475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bad2cce1-3bc6-4a59-8c78-761b7e39097b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.246351 May 16 15:28:12.185107 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 439/872] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:11 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:12.208727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:12.209348 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:12.215317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:12.215784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:12.216559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:12.216996 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:12.353473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:12.361930 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:12.363820 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:12.364970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b90a9e33-6ee4-45ca-bce8-d52b970b746c tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1721 microversion: 2.20 time: 0.160355 May 16 15:28:12.365524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 434/873] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:12 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:13.202358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:13.203287 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:13.211221 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:13.211676 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:13.212527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:13.212959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:13.383504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:13.384314 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:13.391250 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:13.391715 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:13.392492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:13.393126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:13.429852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:13.438468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c7a9cb67-3850-43f9-acd0-ae3e6360f6a9 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.241443 May 16 15:28:13.439076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 440/874] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:13 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:13.535645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:13.549356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:13.549356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:13.549356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-be816efa-9d84-4c34-994e-8bf863b2129b tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1721 microversion: 2.20 time: 0.168348 May 16 15:28:13.549685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 435/875] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:13 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:28:14.455342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:14.455946 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:14.464358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:14.470833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:14.470833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:14.470833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:14.567685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:14.568892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:14.575772 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:14.576573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:14.577611 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:14.578695 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:14.663517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:14.671656 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fe85d542-1f27-4c4a-9b8a-913e9b754a55 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.220128 May 16 15:28:14.672236 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 441/876] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:14 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:14.744500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:14.752702 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:14.754601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:14.755774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7e8e1e77-a21f-4138-83ff-2c819d25aaef tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1724 microversion: 2.20 time: 0.193237 May 16 15:28:14.756503 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 436/877] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:14 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:14.774281 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a08adcfe-87f7-4414-9f48-a1d429f737e1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8aec4bd-acbf-41a9-bcf8-7f9581af1b17"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:14.775368 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a08adcfe-87f7-4414-9f48-a1d429f737e1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:14.781985 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a08adcfe-87f7-4414-9f48-a1d429f737e1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:14.782480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a08adcfe-87f7-4414-9f48-a1d429f737e1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:14.783527 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a08adcfe-87f7-4414-9f48-a1d429f737e1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:14.784121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a08adcfe-87f7-4414-9f48-a1d429f737e1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:15.788220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2c907886-d2b1-45d8-882f-7fbe474b1153 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: .version_select at 0x7fddb3c8aca0>, body: {"keypair": {"name": "tempest-keypair-896680113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhnXbHsVoY20esA2JFbM6yrZU38HY41ralsymvsLA1a12OgCJUsBwt4nDkAcEueQz2M2ecHMUSJd92cN8y7CR4+keyfsdslfBYTZAVPqW2P8W9DwcGy0SbBqahZQUhTBw=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:15.812294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2c907886-d2b1-45d8-882f-7fbe474b1153 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:28:15.817475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2c907886-d2b1-45d8-882f-7fbe474b1153 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:28:15.959210 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a08adcfe-87f7-4414-9f48-a1d429f737e1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.188928 May 16 15:28:15.963541 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2c907886-d2b1-45d8-882f-7fbe474b1153 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.346675 May 16 15:28:15.965408 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 437/878] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:28:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:28:15.966614 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 442/879] 10.222.0.76 () {62 vars in 1363 bytes} [Mon May 16 15:28:14 2022] POST /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-volume_attachments => generated 188 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 16 15:28:15.973329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:15.973957 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:15.980544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:15.982019 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:15.983137 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:15.984346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:16.115847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d0e514e-fb01-4c05-83fb-92561d68cbeb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:16.120130 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d0e514e-fb01-4c05-83fb-92561d68cbeb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:16.140598 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d0e514e-fb01-4c05-83fb-92561d68cbeb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:16.144790 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d0e514e-fb01-4c05-83fb-92561d68cbeb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:16.144790 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d0e514e-fb01-4c05-83fb-92561d68cbeb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:16.146505 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d0e514e-fb01-4c05-83fb-92561d68cbeb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:16.248012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:16.256148 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-43d5e0aa-c017-4b5c-b655-6939950d411b tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.288227 May 16 15:28:16.256742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 438/880] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:15 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:16.434693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1463246485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-88033795", "security_groups": [{"name": "tempest-secgroup-smoke-494742662"}], "block_device_mapping_v2": [{"uuid": "ced1b226-e520-4e20-a4e4-50ed44bc1e29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8109ecd0-18dc-47a3-8ba0-731e552020b2"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:16.557862 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] validate_networks() for [('8109ecd0-18dc-47a3-8ba0-731e552020b2', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:28:17.031195 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d0e514e-fb01-4c05-83fb-92561d68cbeb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-volume_attachments/a8aec4bd-acbf-41a9-bcf8-7f9581af1b17" status: 202 len: 0 microversion: 2.20 time: 0.919738 May 16 15:28:17.033621 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 443/881] 10.222.0.76 () {60 vars in 1456 bytes} [Mon May 16 15:28:16 2022] DELETE /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-volume_attachments/a8aec4bd-acbf-41a9-bcf8-7f9581af1b17 => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:28:17.075620 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:28:17.076126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:28:17.076717 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:28:17.077232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:28:17.077748 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:28:17.090866 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.094842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.094842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.094842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.105825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cf387a43-17de-4372-b3f8-4b6f7b46da59 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:17.108300 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cf387a43-17de-4372-b3f8-4b6f7b46da59 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:17.113045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for project bc74c97613c4462bb551e50800a5f5e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:28:17.115874 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf387a43-17de-4372-b3f8-4b6f7b46da59 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.116608 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf387a43-17de-4372-b3f8-4b6f7b46da59 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.117808 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for user e916a70861fc44e69160faf793999f6d and project bc74c97613c4462bb551e50800a5f5e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:28:17.118643 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf387a43-17de-4372-b3f8-4b6f7b46da59 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.119445 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cf387a43-17de-4372-b3f8-4b6f7b46da59 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.187341 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:28:17.189484 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ced1b226-e520-4e20-a4e4-50ed44bc1e29',volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:28:17.398830 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cf387a43-17de-4372-b3f8-4b6f7b46da59 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "POST /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/action" status: 202 len: 0 microversion: 2.20 time: 0.297911 May 16 15:28:17.404807 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 444/882] 10.222.0.76 () {62 vars in 1318 bytes} [Mon May 16 15:28:17 2022] POST /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 16 15:28:17.408478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:17.411074 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:17.418008 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.419042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.420077 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.420798 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.658609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:17.669629 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-56177743-32cf-44f5-90c5-0e8f0739dd71 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.268382 May 16 15:28:17.674295 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 445/883] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:17 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:17.676410 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:17.677401 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:17.684252 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.684989 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.685793 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:17.686254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:17.753173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a229a53a-a8da-4e30-8ba8-a2b76949ba04 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.323132 May 16 15:28:17.753793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 439/884] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:28:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:28:17.766258 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5dccd93b-99c4-45f1-b1c8-2c5d1779f7e4 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:17.767030 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5dccd93b-99c4-45f1-b1c8-2c5d1779f7e4 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:17.824096 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5dccd93b-99c4-45f1-b1c8-2c5d1779f7e4 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:17.832368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5dccd93b-99c4-45f1-b1c8-2c5d1779f7e4 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1093 microversion: 2.1 time: 0.070791 May 16 15:28:17.838175 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 440/885] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:17 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:17.994697 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:18.026768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:18.031448 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:18.033782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-03e430fc-a50b-47c4-82b2-2b68247d6847 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1672 microversion: 2.20 time: 0.361512 May 16 15:28:18.033782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 446/886] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:17 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1672 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:18.185846 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-05284b8b-d988-456c-b3d0-96e584fe629f req-68399e48-a128-4270-a412-2d4e7bbab8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e9b501-f7d9-4696-a6c2-c1930221431a", "name": "network-vif-plugged", "status": "completed", "tag": "63eb5f5f-0157-446b-b8eb-bc09b2fc4125"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:18.204509 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-05284b8b-d988-456c-b3d0-96e584fe629f req-68399e48-a128-4270-a412-2d4e7bbab8eb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:18.205186 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-05284b8b-d988-456c-b3d0-96e584fe629f req-68399e48-a128-4270-a412-2d4e7bbab8eb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:18.218083 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-05284b8b-d988-456c-b3d0-96e584fe629f req-68399e48-a128-4270-a412-2d4e7bbab8eb service nova] Creating event network-vif-plugged:63eb5f5f-0157-446b-b8eb-bc09b2fc4125 for instance 26e9b501-f7d9-4696-a6c2-c1930221431a on hv-cinder-79053 May 16 15:28:18.223250 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-05284b8b-d988-456c-b3d0-96e584fe629f req-68399e48-a128-4270-a412-2d4e7bbab8eb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042548 May 16 15:28:18.224377 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 441/887] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:18.698729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:18.700506 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:18.720133 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:18.721517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:18.725549 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:18.725998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:18.859980 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2966e934-0427-4074-b8da-4e89054cb0b2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:18.860701 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2966e934-0427-4074-b8da-4e89054cb0b2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:18.949145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2966e934-0427-4074-b8da-4e89054cb0b2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:18.960792 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2966e934-0427-4074-b8da-4e89054cb0b2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1093 microversion: 2.1 time: 0.113949 May 16 15:28:18.967949 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 442/888] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:18 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1093 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:19.052482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:19.053198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:19.062334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:19.062953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:19.063888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:19.064399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:19.255791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:19.265014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:19.266571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:19.267759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c41cd56a-4b97-4f17-9e6d-500bc58a2066 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1672 microversion: 2.20 time: 0.219963 May 16 15:28:19.282305 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 443/889] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:19 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:28:19.289523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:19.297974 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-51cd014a-5665-43a5-b7da-cfe7857b9a36 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1573 microversion: 2.1 time: 0.614518 May 16 15:28:19.298640 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 447/890] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:18 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1573 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:19.367216 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1786813192", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97880a2a-e2c5-4ee9-b5cd-302158bacf22"}], "security_groups": [{"name": "tempest-securitygroup--208736586"}], "key_name": "tempest-keypair-896680113", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:19.492762 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] validate_networks() for [('97880a2a-e2c5-4ee9-b5cd-302158bacf22', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:28:19.897800 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:28:19.898253 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:28:19.898745 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:28:19.899187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:28:19.899730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:28:19.908851 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:19.909297 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:19.910281 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:19.910714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:19.927048 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:28:19.931327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:28:19.944307 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:28:19.946701 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:28:19.978807 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:19.979342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:19.989890 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:19.989890 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:19.989890 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:19.989890 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:20.055024 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:20.063367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-31ff2042-d8d3-415e-83f9-80155d53f20e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1135 microversion: 2.1 time: 0.088665 May 16 15:28:20.063953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 448/891] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:19 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1135 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:20.112494 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fb481ba0-86d8-4442-9f5b-c865d9191bf3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.749545 May 16 15:28:20.113294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 444/892] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:28:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 16 15:28:20.126212 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-74e92b32-2981-4823-8b62-d4357ad90802 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:20.127111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-74e92b32-2981-4823-8b62-d4357ad90802 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:20.188171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-74e92b32-2981-4823-8b62-d4357ad90802 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:20.194738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-74e92b32-2981-4823-8b62-d4357ad90802 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1241 microversion: 2.1 time: 0.073491 May 16 15:28:20.195983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 449/893] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:20 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:20.287598 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:20.288267 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:20.297292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:20.297754 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:20.298713 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:20.299176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:20.315809 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:20.318320 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:20.322366 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:20.323013 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:20.323815 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:20.324254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:20.476816 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:20.485109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0b7fb2df-78f2-494f-b3df-a7b33228542a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1560 microversion: 2.1 time: 0.173114 May 16 15:28:20.485619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 450/894] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:20 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:20.530895 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:20.539630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:20.541137 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:20.542377 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ae0d645e-87e2-435b-b0ec-09d6eb5ef230 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.260206 May 16 15:28:20.544190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 445/895] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:20 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:21.086865 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:21.087487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:21.094424 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:21.094885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:21.095662 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:21.096104 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:21.156931 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:21.164255 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3fdb26c0-f5db-4b29-98f6-f25b73859659 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1199 microversion: 2.1 time: 0.081393 May 16 15:28:21.166058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 451/896] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:21 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:21.220406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:21.221021 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:21.227366 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:21.227816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:21.228574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:21.229017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:21.294036 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:21.301297 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6211759a-3866-4cc6-9cb0-86cd64f1b8ac tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1245 microversion: 2.1 time: 0.084935 May 16 15:28:21.301854 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 446/897] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:21 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:21.563139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:21.563757 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:21.570680 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:21.571135 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:21.571914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:21.572350 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:21.704654 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:21.712847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:21.714384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:21.715579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c9ed133a-6ee2-49e4-9948-34f96a296bee tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.157395 May 16 15:28:21.716135 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 452/898] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:21 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:22.181795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:22.182445 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:22.188423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:22.188875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:22.189648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:22.190089 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:22.248364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:22.255468 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ae114f15-c949-419c-a55c-2cc686f51fc3 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1199 microversion: 2.1 time: 0.077528 May 16 15:28:22.256029 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 447/899] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:22 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:22.318493 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:22.319093 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:22.325743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:22.326201 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:22.326957 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:22.327383 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:22.388380 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:22.395572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f42c0e2c-c133-42a5-984e-8520615ebad3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1245 microversion: 2.1 time: 0.080885 May 16 15:28:22.396138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 453/900] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:22 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:22.736579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:22.737404 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:22.743945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:22.744398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:22.745175 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:22.745616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:22.879723 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:22.888574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:22.890082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:22.891273 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e072eb7d-fbd2-4e31-8a01-d1e37aa25288 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.160043 May 16 15:28:22.891831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 448/901] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:22 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:23.273096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:23.273819 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:23.279955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:23.280404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:23.281175 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:23.281606 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:23.341348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:23.348492 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-769eae30-6773-4f49-91aa-e033c929847c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1199 microversion: 2.1 time: 0.079290 May 16 15:28:23.349079 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 454/902] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:23 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:23.412207 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:23.412813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:23.419752 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:23.420198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:23.420949 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:23.421381 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:23.480536 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:23.488545 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b7aa90d5-b6e8-412c-9f99-a115a7fd7298 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1245 microversion: 2.1 time: 0.080144 May 16 15:28:23.494142 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 449/903] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:23 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:23.912840 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:23.913446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:23.919707 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:23.920157 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:23.921058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:23.921804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:24.094382 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:24.109715 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:24.111284 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:24.112482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bacca4b2-1605-4cea-9bb2-9b13d206db4e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.203507 May 16 15:28:24.115963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 455/904] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:23 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:28:24.365554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:24.366202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:24.372910 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:24.373688 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:24.375050 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:24.375711 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:24.457653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:24.473173 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c996151a-af19-48c5-8152-bcd39a9e34db tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1209 microversion: 2.1 time: 0.111643 May 16 15:28:24.475339 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 450/905] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:24 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:24.514225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:24.515631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:24.524022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:24.524783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:24.525785 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:24.526675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:24.619402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:24.630142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ae6f69e7-e5f8-4312-a13c-66d59b8c1c73 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.122909 May 16 15:28:24.631059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 456/906] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:24 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:25.137120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:25.146023 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:25.153757 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:25.154315 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:25.155187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:25.155695 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:25.307302 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:25.316733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:25.318417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:25.319824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bcb0f41c-ed31-48cb-a15d-e52104fa0bc9 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.189043 May 16 15:28:25.320469 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 451/907] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:25 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:25.492781 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:25.493576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:25.500171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:25.500631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:25.501420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:25.501860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:25.653403 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:25.654353 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:25.655033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:25.661026 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a304edbe-c37d-46b8-a05c-462ce02cea76 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.172407 May 16 15:28:25.664784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:25.664931 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 457/908] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:25 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:25.665030 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:25.665030 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:25.665030 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:25.749298 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:25.757744 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7c8342ef-61b2-44ff-848f-ed90f2c00d57 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.107387 May 16 15:28:25.758753 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 452/909] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:25 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:26.347411 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:26.348048 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:26.354250 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:26.354773 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:26.355620 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:26.356754 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:26.509215 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:26.518515 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:26.520201 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:26.521468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e07c068b-ad9b-4b28-a8f4-590cb77e13e2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.178050 May 16 15:28:26.522034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 458/910] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:26 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:26.678310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:26.678923 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:26.685353 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:26.685791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:26.686577 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:26.687006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:26.776921 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:26.779044 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:26.787180 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:26.787916 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:26.789171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:26.789835 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:26.858774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:26.866552 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0ffbd87a-f6e5-4b76-9a87-d92597ab203d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.192242 May 16 15:28:26.867133 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 453/911] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:26 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:26.886219 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:26.895174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b4a11769-efc1-45dc-9378-821640541114 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.122215 May 16 15:28:26.895705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 459/912] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:26 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:27.540226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:27.540944 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:27.547573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:27.548164 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:27.548941 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:27.549385 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:27.687299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:27.695792 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:27.697875 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:27.699753 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e17d3cb9-e712-4c29-ae3f-ee2682ebbdd2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.163606 May 16 15:28:27.700653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 454/913] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:27 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:27.885922 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:27.887344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:27.894488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:27.894946 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:27.895741 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:27.896186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:27.912599 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:27.913490 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:27.921020 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:27.921488 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:27.922302 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:27.922750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:28.063810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:28.071972 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5b7f7da1-d3a7-477a-ad62-faf330e1ced4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.163111 May 16 15:28:28.079693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 455/914] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:27 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:28.122573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:28.129891 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d04ebd3b-3f3b-4248-baeb-f66a983b444f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.248635 May 16 15:28:28.130490 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 460/915] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:27 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:28.718612 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:28.719380 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:28.730360 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:28.730816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:28.731642 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:28.732084 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:28.869104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:28.879097 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:28.880925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:28.882643 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ca82e9dd-52eb-4b70-996e-34740cf1e99e tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.167934 May 16 15:28:28.887892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 456/916] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:28 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:29.095899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:29.096519 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:29.103188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:29.103643 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:29.104422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:29.105013 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:29.147077 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:29.147723 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:29.153773 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:29.154248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:29.155032 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:29.155474 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:29.182936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:29.191593 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f0a4e618-cde9-48d5-906d-827226392ba6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.099667 May 16 15:28:29.192200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 461/917] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:29 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:29.312614 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:29.320835 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0f035fe6-1b3f-4348-9d9a-3a4e47a49cfd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.177396 May 16 15:28:29.327916 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 457/918] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:29 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:29.902340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:29.904270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:29.919608 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:29.920317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:29.921246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:29.921768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:30.077253 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:30.093391 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:30.094963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:30.096162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-514b7a6f-fc6a-4a41-8133-57c47c5d8a9d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.198193 May 16 15:28:30.097049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 462/919] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:29 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:30.208783 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:30.209549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:30.216093 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:30.216551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:30.217312 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:30.217750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:30.301220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:30.312815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-86baff26-72e9-405b-8701-05e5cd25ac8f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.107208 May 16 15:28:30.330049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 458/920] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:30 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:30.340019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:30.341659 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:30.350151 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:30.351036 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:30.352394 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:30.353037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:30.503391 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:30.511275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-34b21859-ae57-4549-bd8a-eb966f1ee27a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.176094 May 16 15:28:30.511868 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 463/921] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:30 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:31.119104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:31.119104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:31.124177 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:31.124885 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:31.125705 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:31.126277 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:31.280813 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:31.292549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:31.301648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:31.304038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-88f35170-eacf-45c8-8555-fe7f5ebaa3a4 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.192540 May 16 15:28:31.305484 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 459/922] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:31 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 16 15:28:31.339810 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:31.341764 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:31.352330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:31.352798 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:31.353631 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:31.354072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:31.421050 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:31.429921 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ad02f36f-5157-4375-9c3d-122fe8605c02 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.093831 May 16 15:28:31.430789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 464/923] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:31 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:31.529322 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:31.529940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:31.536062 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:31.536515 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:31.537292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:31.537731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:31.694912 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:31.702636 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c20aae21-cce8-40bf-85b7-26ea4fe84211 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.177710 May 16 15:28:31.703204 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 460/924] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:31 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:32.324824 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:32.326331 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:32.333406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:32.334562 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:32.337726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:32.337726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:32.446816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:32.448795 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:32.456459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:32.457151 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:32.458273 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:32.458939 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:32.487092 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:32.490292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:32.492085 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:32.493295 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ace5eb26-6089-4967-a750-fae9d1f7c0ed tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.174126 May 16 15:28:32.493860 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 465/925] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:32 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:32.530310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:32.550104 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0a83d167-9a44-4160-a1c8-dad05747c203 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.103466 May 16 15:28:32.550792 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 461/926] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:32 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:32.721452 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:32.722368 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:32.732498 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:32.733507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:32.734909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:32.739749 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:32.971423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:32.979456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a953053e-8689-485d-abe2-0a19c9986cb0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.263604 May 16 15:28:32.980258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 466/927] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:32 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:33.513960 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:33.514670 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:33.520765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:33.521425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:33.522234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:33.522852 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:33.568252 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:33.569475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:33.577801 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:33.580125 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:33.585696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:33.586161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:33.651251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:33.659639 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-63d51945-a668-40df-8451-56b332aaba08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1293 microversion: 2.1 time: 0.095867 May 16 15:28:33.667183 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 467/928] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:33 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:33.678766 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:33.686489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:33.687947 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:33.689095 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-33ef4db2-8046-4bea-af20-81cdac566237 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.180743 May 16 15:28:33.689649 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 462/929] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:33 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:33.996638 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:33.997813 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:34.003771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:34.004219 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:34.004990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:34.005455 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:34.142625 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:34.150503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a3b89bc6-590e-4177-8709-e82f1911efef tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.157701 May 16 15:28:34.151149 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 468/930] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:33 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:34.676616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:34.683314 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:34.684165 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:34.684658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:34.685440 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:34.685999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:34.707520 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:34.708133 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:34.714443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:34.718067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:34.718067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:34.718067 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:34.754285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:34.762465 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d5c6c740-e396-426f-9d80-1a7fc9fa5a62 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1301 microversion: 2.1 time: 0.089735 May 16 15:28:34.763034 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 463/931] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:34 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:34.848101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:34.855990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:34.858097 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:34.859672 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dde6bd3e-1db4-4c8d-a6e4-a259952284bc tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.156308 May 16 15:28:34.860238 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 469/932] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:34 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:35.166463 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:35.167080 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:35.173005 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.173455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.174252 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.179885 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.289975 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e5550a8a-7410-4db4-9e3b-f830a56073d7 req-22c5e846-e278-4ae3-8078-46bfe197ef4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9", "tag": "b74b55c2-b9e6-45c4-a2d6-501d7668af37"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:35.302833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e5550a8a-7410-4db4-9e3b-f830a56073d7 req-22c5e846-e278-4ae3-8078-46bfe197ef4a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.312091 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e5550a8a-7410-4db4-9e3b-f830a56073d7 req-22c5e846-e278-4ae3-8078-46bfe197ef4a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.327943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e5550a8a-7410-4db4-9e3b-f830a56073d7 req-22c5e846-e278-4ae3-8078-46bfe197ef4a service nova] Creating event network-changed:b74b55c2-b9e6-45c4-a2d6-501d7668af37 for instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 on hv-cinder-79053 May 16 15:28:35.335533 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e5550a8a-7410-4db4-9e3b-f830a56073d7 req-22c5e846-e278-4ae3-8078-46bfe197ef4a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048229 May 16 15:28:35.336848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 470/933] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:28:35.343911 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-549152865", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "networks": [{"uuid": "4c8c86fc-cc7b-4b4b-8bf7-d981372cf4b0"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:35.430019 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] validate_networks() for [('4c8c86fc-cc7b-4b4b-8bf7-d981372cf4b0', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:28:35.496604 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:35.516797 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2ea1edf0-40f8-45e2-b727-0f8507e86888 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1276 microversion: 2.1 time: 0.354017 May 16 15:28:35.517391 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 464/934] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:35 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1276 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:35.779967 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:35.781292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:35.788169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.788630 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.789412 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.790021 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.848052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:28:35.848571 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:28:35.849268 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:28:35.849776 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:28:35.850324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:28:35.865585 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.866166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.867074 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.867428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:35.867688 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.889193 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9cd84622-6bb6-4f84-9fc0-bea1dbbb2724 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1311 microversion: 2.1 time: 0.113038 May 16 15:28:35.897353 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Getting quotas for project 38f2e257d56d477d98132d62b4f87b19. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:28:35.897511 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 465/935] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:35 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:35.897624 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Getting quotas for user b52ac049f28842cbb53a283a40142faf and project 38f2e257d56d477d98132d62b4f87b19. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:28:35.897742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:35.897742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:35.902774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.903419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.904622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:35.905222 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:35.907691 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:28:35.910938 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:28:36.032621 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5b00d4dd-4021-4574-82dc-0c23eb2c8e29 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694155 May 16 15:28:36.033509 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 471/936] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:28:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:28:36.044621 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a7730513-405a-44df-8991-99c4606f0acc tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:36.045064 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a7730513-405a-44df-8991-99c4606f0acc tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:36.118405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a7730513-405a-44df-8991-99c4606f0acc tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:36.127093 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a7730513-405a-44df-8991-99c4606f0acc tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1213 microversion: 2.1 time: 0.087341 May 16 15:28:36.139377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 472/937] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:36 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:36.441006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:36.449051 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:36.451115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:36.452333 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b165a6f5-db65-493f-b832-c8d4813b8dad tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.560889 May 16 15:28:36.452891 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 466/938] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:35 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:36.533798 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:36.534610 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:36.541946 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:36.542942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:36.544442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:36.545138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:36.703841 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:36.709389 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bd2e05b0-a947-4d63-a79e-ed29cb243caa tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.180285 May 16 15:28:36.718683 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 473/939] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:36 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:36.906685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:36.907308 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:36.914497 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:36.920483 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:36.920483 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:36.920483 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:36.978971 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:36.986391 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d5a4bc8a-2286-4b37-995c-1c8d4151d6c4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1299 microversion: 2.1 time: 0.083688 May 16 15:28:36.994207 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 467/940] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:36 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:37.146681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-66e94ac8-f9c3-41d0-8857-d9102da48e19 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:37.147715 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-66e94ac8-f9c3-41d0-8857-d9102da48e19 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:37.203191 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-66e94ac8-f9c3-41d0-8857-d9102da48e19 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:37.211942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-66e94ac8-f9c3-41d0-8857-d9102da48e19 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1213 microversion: 2.1 time: 0.070801 May 16 15:28:37.212578 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 474/941] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:37 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:37.470014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:37.470757 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:37.476986 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:37.477527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:37.482539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:37.482539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:37.667623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:37.676200 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:37.677710 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:37.678907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8e50190b-6ebb-47c9-8f8e-b6956614e2c8 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.212936 May 16 15:28:37.679474 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 468/942] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:37 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:37.727995 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:37.728652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:37.736486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:37.737184 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:37.738240 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:37.738785 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:37.901488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:37.909855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7e7140fd-e044-4eb3-afff-8ca920b14a63 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.186269 May 16 15:28:37.910564 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 475/943] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:37 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:38.003504 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:38.004153 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:38.012217 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.013184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.014345 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.014865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.064274 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-3447e09e-169d-44e6-bded-c1e5fdffb104 req-66d53b50-8020-430c-9feb-54eb7a458bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6", "tag": "927a3b06-5b59-49a1-9454-0f5b417ac4b8"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:38.078845 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3447e09e-169d-44e6-bded-c1e5fdffb104 req-66d53b50-8020-430c-9feb-54eb7a458bd5 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.080163 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3447e09e-169d-44e6-bded-c1e5fdffb104 req-66d53b50-8020-430c-9feb-54eb7a458bd5 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.096935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-3447e09e-169d-44e6-bded-c1e5fdffb104 req-66d53b50-8020-430c-9feb-54eb7a458bd5 service nova] Creating event network-changed:927a3b06-5b59-49a1-9454-0f5b417ac4b8 for instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 on hv-cinder-79053 May 16 15:28:38.102567 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-3447e09e-169d-44e6-bded-c1e5fdffb104 req-66d53b50-8020-430c-9feb-54eb7a458bd5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044115 May 16 15:28:38.104339 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 476/944] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:38.188268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:38.197658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d474d705-1f9c-480e-8b40-9f0928a9967d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.197132 May 16 15:28:38.197658 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 469/945] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:37 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:38.233082 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:38.235270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:38.245502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.246072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.246992 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.247457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.276079 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-52faa9a0-5b94-4ead-8769-3bfb74f228d0 req-7e69e536-04a4-41aa-b5b1-d1f0f015db5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3d7e6a-43dc-42b0-a663-56ad894c3801", "name": "network-vif-plugged", "status": "completed", "tag": "588be31f-e001-4d2f-97c9-ef1bb2eeef86"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:38.287233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-52faa9a0-5b94-4ead-8769-3bfb74f228d0 req-7e69e536-04a4-41aa-b5b1-d1f0f015db5a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.287905 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-52faa9a0-5b94-4ead-8769-3bfb74f228d0 req-7e69e536-04a4-41aa-b5b1-d1f0f015db5a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.300321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-52faa9a0-5b94-4ead-8769-3bfb74f228d0 req-7e69e536-04a4-41aa-b5b1-d1f0f015db5a service nova] Creating event network-vif-plugged:588be31f-e001-4d2f-97c9-ef1bb2eeef86 for instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 on hv-cinder-79053 May 16 15:28:38.307505 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-52faa9a0-5b94-4ead-8769-3bfb74f228d0 req-7e69e536-04a4-41aa-b5b1-d1f0f015db5a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038018 May 16 15:28:38.308115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 470/946] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:28:38.323540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:38.332870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fde2f5f2-da80-4f61-af8e-d9877a7f950d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1265 microversion: 2.1 time: 0.105306 May 16 15:28:38.333470 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 477/947] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:38 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:38.697323 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:38.698030 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:38.704878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.705332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.706120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.706579 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.926397 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:38.932788 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:38.932788 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:38.933870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.935108 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.935660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:38.935895 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:38.936334 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:38.937220 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:38.938534 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5dca4d63-82ed-4c13-828c-7908d7e5f6a0 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.245801 May 16 15:28:38.939285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 471/948] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:38 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:39.080986 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:39.088366 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-85314a17-e65d-44d2-9990-8bd6fad2f3b6 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.164926 May 16 15:28:39.089220 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 478/949] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:38 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:39.213790 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:39.214423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:39.221492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:39.221938 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:39.222746 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:39.223193 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:39.350514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:39.351210 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:39.358323 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:39.359464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:39.360500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:39.361090 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:39.431245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:39.440031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c35580e6-9567-4270-bbfa-bede67d5c271 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1283 microversion: 2.1 time: 0.093740 May 16 15:28:39.441938 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 479/950] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:39 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:39.478517 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:39.485722 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0bd09892-9821-4381-8a67-f19b799ab69a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.275831 May 16 15:28:39.486307 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 472/951] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:39 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:39.957484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:39.958091 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:39.966717 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:39.967172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:39.967961 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:39.968402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:40.099193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:40.105002 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:40.105618 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:40.107122 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:40.108624 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:40.109801 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-35701703-a257-47cd-9b8e-fefcecdb5fca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.156845 May 16 15:28:40.110396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 480/952] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:39 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:40.111593 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:40.112052 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:40.112839 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:40.113285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:40.244306 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:40.252387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c8113441-2bc2-4829-8841-9fd0213f8018 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.151370 May 16 15:28:40.252957 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 473/953] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:40 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:40.456645 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:40.457358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:40.463188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:40.463636 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:40.464405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:40.464833 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:40.509622 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:40.510266 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:40.516482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:40.521938 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:40.521938 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:40.521938 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:40.596218 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:40.603316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-31e301c9-502b-4a5e-a239-1785b4cb1b3d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.150527 May 16 15:28:40.603986 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 481/954] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:40 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:40.762818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:40.770026 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f58c4467-ec0f-4005-9a53-c9f576c6c5e9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.264246 May 16 15:28:40.770638 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 474/955] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:40 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:41.128043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:41.128684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:41.135394 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.136117 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.136893 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.137347 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.268492 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:41.270570 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:41.270570 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:41.276730 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.277397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:41.277810 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.279419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.279664 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:41.280318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.280837 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c2593655-1877-473d-b0c5-d8101c3901f2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.156762 May 16 15:28:41.291070 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 482/956] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:41 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:41.315205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-345869fc-f672-40c0-b968-6a6a0a341034 req-b723ada7-8ca1-4b8c-90d8-5cd9d9eb4d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112e1c65-fca5-4734-bdf8-b52350394574", "tag": "1ff63ec5-9b82-4952-88fe-89318e4202a2"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:41.334387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-345869fc-f672-40c0-b968-6a6a0a341034 req-b723ada7-8ca1-4b8c-90d8-5cd9d9eb4d12 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.334840 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-345869fc-f672-40c0-b968-6a6a0a341034 req-b723ada7-8ca1-4b8c-90d8-5cd9d9eb4d12 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.356225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-345869fc-f672-40c0-b968-6a6a0a341034 req-b723ada7-8ca1-4b8c-90d8-5cd9d9eb4d12 service nova] Creating event network-changed:1ff63ec5-9b82-4952-88fe-89318e4202a2 for instance 112e1c65-fca5-4734-bdf8-b52350394574 on hv-cinder-79053 May 16 15:28:41.361709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-345869fc-f672-40c0-b968-6a6a0a341034 req-b723ada7-8ca1-4b8c-90d8-5cd9d9eb4d12 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050083 May 16 15:28:41.362377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 483/957] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:41.441899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:41.449276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a56d8f43-16fa-474a-8b61-8fd48946c454 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.183398 May 16 15:28:41.449839 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 475/958] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:41 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:41.621332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:41.622575 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:41.629033 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.629485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.630292 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.630731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.770436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:41.777996 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8a225d05-eea0-42de-aeb5-3a70766dbaa1 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.160926 May 16 15:28:41.779081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 484/959] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:41 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:41.786975 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:41.787745 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:41.793747 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.794232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:41.795002 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:41.796163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:42.000351 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:42.007893 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-78dd03f2-ec94-4699-9fc5-a03e9c2d8e95 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.224539 May 16 15:28:42.008337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 476/960] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:41 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:42.301802 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:42.302485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:42.310909 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:42.311784 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:42.315311 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:42.315954 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:42.449939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:42.457623 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:42.459152 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:42.460303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-15f6a1e1-c760-48ed-a96f-e7f7d1fd1b36 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1730 microversion: 2.20 time: 0.165383 May 16 15:28:42.460905 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 485/961] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:42 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:42.466525 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:42.467161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:42.473497 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:42.473955 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:42.474807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:42.475248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:42.611743 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:42.619694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7b7c5b56-3e2c-4e8e-90de-bb7574b86cd1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.157082 May 16 15:28:42.620586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 477/962] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:42 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:42.794453 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:42.795119 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:42.801717 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:42.802193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:42.802960 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:42.803391 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:42.933293 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:42.944857 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ff24e9da-5519-40eb-8e49-e61a13741d8d tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.154259 May 16 15:28:42.945463 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 486/963] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:42 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:43.025019 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:43.025735 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:43.032439 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.039022 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:43.039022 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.039022 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:43.207063 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:43.214476 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-22c0f17d-c6a8-4431-8780-fecb53c8802d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.193388 May 16 15:28:43.215129 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 478/964] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:43 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:43.478561 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:43.479209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:43.485575 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.486029 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:43.486850 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.487288 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:43.613324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:43.621270 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:43.622811 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:43.624478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d10be72-b16d-404a-900f-4664024cac0d tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1717 microversion: 2.20 time: 0.149904 May 16 15:28:43.625059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 487/965] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:28:43 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1717 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:28:43.640247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:43.640926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:43.647329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.647781 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:43.648551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.648991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:43.774562 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:43.781847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e11c8492-ed59-4596-963c-e82936e480cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.146289 May 16 15:28:43.782451 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 479/966] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:43 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:43.961652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:43.962289 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:43.968275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.968724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:43.969491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:43.969932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:44.094647 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:44.103050 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-62855a28-6954-479c-b688-7ff631e78fe7 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.145192 May 16 15:28:44.103602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 488/967] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:43 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:44.231984 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:44.233446 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:44.241043 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:44.241499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:44.242317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:44.242929 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:44.377947 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:44.385447 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1db2e9fa-d2dc-43cf-81b8-62c282315d6a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.157472 May 16 15:28:44.386487 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 480/968] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:44 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:44.527963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-2d1925c3-55a7-4c7f-8053-91025a539719 req-ecd6e49f-9a91-4f99-8a40-f8308b9191aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6", "name": "network-vif-plugged", "status": "completed", "tag": "927a3b06-5b59-49a1-9454-0f5b417ac4b8"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:44.536703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2d1925c3-55a7-4c7f-8053-91025a539719 req-ecd6e49f-9a91-4f99-8a40-f8308b9191aa service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:44.537146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-2d1925c3-55a7-4c7f-8053-91025a539719 req-ecd6e49f-9a91-4f99-8a40-f8308b9191aa service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:44.549346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-2d1925c3-55a7-4c7f-8053-91025a539719 req-ecd6e49f-9a91-4f99-8a40-f8308b9191aa service nova] Creating event network-vif-plugged:927a3b06-5b59-49a1-9454-0f5b417ac4b8 for instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 on hv-cinder-79053 May 16 15:28:44.554491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-2d1925c3-55a7-4c7f-8053-91025a539719 req-ecd6e49f-9a91-4f99-8a40-f8308b9191aa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030409 May 16 15:28:44.555345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 489/969] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:44.797692 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:44.798333 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:44.804879 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:44.805261 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:44.806028 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:44.806482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:44.965564 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:44.973428 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-dccd5abc-ac84-47a2-a3e4-f99c0dea6c58 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.179718 May 16 15:28:44.974012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 481/970] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:44 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:45.120221 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:45.120911 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:45.127408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:45.127849 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:45.128601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:45.129027 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:45.255746 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:45.263088 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-694bcbb0-bf9f-4e15-92aa-c94692093416 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.147113 May 16 15:28:45.263650 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 490/971] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:45 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:45.402060 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:45.402638 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:45.408577 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:45.409029 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:45.409796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:45.410284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:45.535406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:45.542933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-aeb7c2b1-9fa6-4f45-87d0-d1f9a7b2ef9d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.144763 May 16 15:28:45.543500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 482/972] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:45 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:45.989892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:45.990540 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:45.996810 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:45.997265 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:45.998050 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:45.998500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:46.124337 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:46.131625 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4e8a1df6-6dfa-402a-bfcb-ded75140d227 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.145597 May 16 15:28:46.132370 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 491/973] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:45 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:46.281247 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:46.281801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:46.288936 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:46.289276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:46.289977 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:46.290454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:46.419183 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:46.426573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1d286d26-1836-407c-b423-2b265f88bd07 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.149907 May 16 15:28:46.427149 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 483/974] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:46 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:46.560710 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:46.562111 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:46.568436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:46.569010 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:46.570043 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:46.570604 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:46.572739 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-c41be57d-bec6-49cc-8120-2c1891db9f4d req-415e0cf4-aba3-4383-bbb6-ff52686decae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9", "name": "network-vif-plugged", "status": "completed", "tag": "b74b55c2-b9e6-45c4-a2d6-501d7668af37"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:46.586901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c41be57d-bec6-49cc-8120-2c1891db9f4d req-415e0cf4-aba3-4383-bbb6-ff52686decae service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:46.586901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-c41be57d-bec6-49cc-8120-2c1891db9f4d req-415e0cf4-aba3-4383-bbb6-ff52686decae service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:46.594817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-c41be57d-bec6-49cc-8120-2c1891db9f4d req-415e0cf4-aba3-4383-bbb6-ff52686decae service nova] Creating event network-vif-plugged:b74b55c2-b9e6-45c4-a2d6-501d7668af37 for instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 on hv-cinder-79053 May 16 15:28:46.600007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-c41be57d-bec6-49cc-8120-2c1891db9f4d req-415e0cf4-aba3-4383-bbb6-ff52686decae service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031135 May 16 15:28:46.600641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 484/975] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:28:46.710393 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:46.716699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ebaeec8d-5940-4ca0-9a1a-5ac87d3e89e7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1366 microversion: 2.1 time: 0.160187 May 16 15:28:46.717356 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 492/976] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:46 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:47.149259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:47.149964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:47.157069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.157527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.158345 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.158785 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.348516 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:47.355806 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-52161f13-e621-4f84-9c0a-76217d4adeab tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.210853 May 16 15:28:47.356500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 485/977] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:47 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:47.443059 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:47.443634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:47.449879 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.450365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.451116 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.451543 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.578573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:47.586084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2b2f7df7-5ee4-4749-b8c2-fbcf84c91c35 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.146858 May 16 15:28:47.586686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 493/978] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:47 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:47.734859 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:47.735733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:47.746852 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.747310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.748127 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.749219 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.875582 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:47.882829 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b20bb9bf-cded-4d6b-89c5-196db22d3e68 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1554 microversion: 2.1 time: 0.152487 May 16 15:28:47.883394 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 486/979] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:47 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:47.899208 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e0ae424b-ebad-4d73-bb6d-d508dfb682b7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:47.899707 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e0ae424b-ebad-4d73-bb6d-d508dfb682b7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:47.905525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0ae424b-ebad-4d73-bb6d-d508dfb682b7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.905974 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0ae424b-ebad-4d73-bb6d-d508dfb682b7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.906811 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0ae424b-ebad-4d73-bb6d-d508dfb682b7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:47.907246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0ae424b-ebad-4d73-bb6d-d508dfb682b7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:47.979713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e0ae424b-ebad-4d73-bb6d-d508dfb682b7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.084307 May 16 15:28:47.980310 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 494/980] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:28:47 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-interface => generated 284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:48.373788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:48.374466 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:48.381788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:48.383218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:48.383218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:48.384500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:48.518968 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:48.526273 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b81298ae-6cc5-4c43-b168-843a9b4447da tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1264 microversion: 2.1 time: 0.157259 May 16 15:28:48.526836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 487/981] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:48 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:48.603580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:48.604198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:48.610555 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:48.611004 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:48.611789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:48.612227 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:48.615554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-84c033ec-0238-4f24-a615-7d58eba3a817 req-28683edf-353c-47af-835b-7164d238347e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112e1c65-fca5-4734-bdf8-b52350394574", "name": "network-vif-plugged", "status": "completed", "tag": "1ff63ec5-9b82-4952-88fe-89318e4202a2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:48.624018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-84c033ec-0238-4f24-a615-7d58eba3a817 req-28683edf-353c-47af-835b-7164d238347e service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:48.624471 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-84c033ec-0238-4f24-a615-7d58eba3a817 req-28683edf-353c-47af-835b-7164d238347e service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:48.635703 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-84c033ec-0238-4f24-a615-7d58eba3a817 req-28683edf-353c-47af-835b-7164d238347e service nova] Creating event network-vif-plugged:1ff63ec5-9b82-4952-88fe-89318e4202a2 for instance 112e1c65-fca5-4734-bdf8-b52350394574 on hv-cinder-79053 May 16 15:28:48.642088 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-84c033ec-0238-4f24-a615-7d58eba3a817 req-28683edf-353c-47af-835b-7164d238347e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029982 May 16 15:28:48.642617 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 488/982] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:48.843649 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:48.851307 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-10076de8-6265-4d0b-8f4d-a5ff95010b14 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.252140 May 16 15:28:48.852468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 495/983] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:48 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:49.070879 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-fcace2e3-34b1-4677-82b2-18eeb9cbc7f4 req-3287ce7d-1bc6-4eda-ba7c-e42fb2912201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6", "tag": "927a3b06-5b59-49a1-9454-0f5b417ac4b8"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:49.079907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fcace2e3-34b1-4677-82b2-18eeb9cbc7f4 req-3287ce7d-1bc6-4eda-ba7c-e42fb2912201 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.081363 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-fcace2e3-34b1-4677-82b2-18eeb9cbc7f4 req-3287ce7d-1bc6-4eda-ba7c-e42fb2912201 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.093116 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-fcace2e3-34b1-4677-82b2-18eeb9cbc7f4 req-3287ce7d-1bc6-4eda-ba7c-e42fb2912201 service nova] Creating event network-changed:927a3b06-5b59-49a1-9454-0f5b417ac4b8 for instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 on hv-cinder-79053 May 16 15:28:49.098023 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-fcace2e3-34b1-4677-82b2-18eeb9cbc7f4 req-3287ce7d-1bc6-4eda-ba7c-e42fb2912201 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031310 May 16 15:28:49.098671 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 489/984] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:49.547687 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:49.548865 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:49.558817 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.559264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.560031 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.560487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.694752 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:49.702248 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f43a3a54-9a41-4682-8969-ae3856609d70 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1451 microversion: 2.1 time: 0.162590 May 16 15:28:49.702820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 496/985] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:49 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:49.719802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:49.720668 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:49.728223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.728684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.729478 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.729923 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.869347 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:49.870121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:49.878198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.878579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.880464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:49.881497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:49.906443 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:49.915726 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a1730a21-2bf5-4a60-adef-b92f33e0b4eb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1451 microversion: 2.1 time: 0.200591 May 16 15:28:49.916625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 490/986] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:49 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1451 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:50.041553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:50.052380 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d0fa987f-64ca-400a-a354-52f73aae75a3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1313 microversion: 2.1 time: 0.187282 May 16 15:28:50.055641 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 497/987] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:49 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:51.068655 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:51.069271 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:51.075556 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:51.076003 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:51.076821 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:51.080951 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:51.205691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:51.213163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7e11945a-2a75-46d1-84fa-458f14546bf0 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1498 microversion: 2.1 time: 0.148302 May 16 15:28:51.213731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 491/988] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:51 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:52.058157 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:52.059405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:52.066245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:52.066828 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:52.067614 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:52.068048 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:52.094792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:28:52.120491 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-a372c36e-0520-465c-8ca2-bd54de942328 req-75b3e238-9984-48b2-8225-1eba77b76f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9", "tag": "b74b55c2-b9e6-45c4-a2d6-501d7668af37"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:52.129361 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-a372c36e-0520-465c-8ca2-bd54de942328 req-75b3e238-9984-48b2-8225-1eba77b76f3c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:52.130058 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-a372c36e-0520-465c-8ca2-bd54de942328 req-75b3e238-9984-48b2-8225-1eba77b76f3c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:52.141333 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-a372c36e-0520-465c-8ca2-bd54de942328 req-75b3e238-9984-48b2-8225-1eba77b76f3c service nova] Creating event network-changed:b74b55c2-b9e6-45c4-a2d6-501d7668af37 for instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 on hv-cinder-79053 May 16 15:28:52.146601 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-a372c36e-0520-465c-8ca2-bd54de942328 req-75b3e238-9984-48b2-8225-1eba77b76f3c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029652 May 16 15:28:52.147293 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 492/989] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:28:52.335806 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-178cc3aa-16b7-4e1f-84ad-8e358a8e7106 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "DELETE /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 204 len: 0 microversion: 2.1 time: 0.281436 May 16 15:28:52.336407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 498/990] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:28:52 2022] DELETE /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:28:52.350560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:52.351258 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:52.361238 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:52.362018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:52.367794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:52.367794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:52.498964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:52.507177 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-79cb8ef2-1807-4750-84f7-2d9e60e38aac tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1504 microversion: 2.1 time: 0.160774 May 16 15:28:52.507767 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 493/991] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:52 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:53.525744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:53.526512 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:53.533799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:53.534216 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:53.534988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:53.535428 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:53.667502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:53.675387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-41076c7d-d549-4a00-a8aa-16d02db66160 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1504 microversion: 2.1 time: 0.154170 May 16 15:28:53.675953 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 499/992] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:53 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:54.535189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e7eb1a28-59e6-489d-8e47-fa87723475e7 req-efdf31a7-fa29-46bd-98e6-15d5361485f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112e1c65-fca5-4734-bdf8-b52350394574", "name": "network-vif-deleted", "tag": "1ff63ec5-9b82-4952-88fe-89318e4202a2"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:54.543437 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e7eb1a28-59e6-489d-8e47-fa87723475e7 req-efdf31a7-fa29-46bd-98e6-15d5361485f0 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:54.543917 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e7eb1a28-59e6-489d-8e47-fa87723475e7 req-efdf31a7-fa29-46bd-98e6-15d5361485f0 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:54.692782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:54.693389 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:54.699972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:54.700415 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:54.701185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:54.701622 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:54.708523 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e7eb1a28-59e6-489d-8e47-fa87723475e7 req-efdf31a7-fa29-46bd-98e6-15d5361485f0 service nova] Creating event network-vif-deleted:1ff63ec5-9b82-4952-88fe-89318e4202a2 for instance 112e1c65-fca5-4734-bdf8-b52350394574 on hv-cinder-79053 May 16 15:28:54.713976 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e7eb1a28-59e6-489d-8e47-fa87723475e7 req-efdf31a7-fa29-46bd-98e6-15d5361485f0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182438 May 16 15:28:54.714945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 494/993] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:54.773785 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:54.781876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-818c96a5-32e8-4411-a312-1964ef1c1279 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 200 len: 1298 microversion: 2.1 time: 0.093177 May 16 15:28:54.782465 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 500/994] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:54 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:28:55.799663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:55.800443 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 112e1c65-fca5-4734-bdf8-b52350394574] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:55.806521 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:55.806962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:55.807720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:55.808145 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:55.821399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] HTTP exception thrown: Instance 112e1c65-fca5-4734-bdf8-b52350394574 could not be found. May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Request method failure captured: May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 HTTP/1.1 May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2h8-QAWxX0RVgIyu9XlnAGe0Wlnc9lvs3XHqNATK54-lVPf3LmbRdN9JFN0EaO_4il-wZ6IlU4u6pjLASBhNwxobNWHIpzbCxvu3JUAn4zN68ksaa1JmHX3UzthQwnf7RTYo3nSQjfW2FB9crJgeV77XAceaiUpm0FhpbfFhU8T9Y May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: 38f2e257d56d477d98132d62b4f87b19 May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesActionsTest-841429724 May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:28:55.823033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38f2e257d56d477d98132d62b4f87b19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38f2e257d56d477d98132d62b4f87b19", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38f2e257d56d477d98132d62b4f87b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38f2e257d56d477d98132d62b4f87b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesActionsTest-841429724 May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: 38f2e257d56d477d98132d62b4f87b19 May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesActionsTest-841429724 May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesActionsTest-841429724-project May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: b52ac049f28842cbb53a283a40142faf May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesActionsTest-841429724-project May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 112e1c65-fca5-4734-bdf8-b52350394574 could not be found. May 16 15:28:55.824684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '112e1c65-fca5-4734-bdf8-b52350394574'} May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112e1c65-fca5-4734-bdf8-b52350394574 could not be found. May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:28:55.825575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112e1c65-fca5-4734-bdf8-b52350394574 could not be found. May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112e1c65-fca5-4734-bdf8-b52350394574 could not be found. May 16 15:28:55.827901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:28:55.829155 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Returning 404 to user: Instance 112e1c65-fca5-4734-bdf8-b52350394574 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:28:55.829155 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9d16128a-4775-4d42-becf-aecd69871dbf tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574" status: 404 len: 111 microversion: 2.1 time: 0.029563 May 16 15:28:55.829155 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 495/995] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:55 2022] GET /compute/v2.1/servers/112e1c65-fca5-4734-bdf8-b52350394574 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:28:55.878047 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-298256990", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "networks": [{"uuid": "4c8c86fc-cc7b-4b4b-8bf7-d981372cf4b0"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:55.929330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] validate_networks() for [('4c8c86fc-cc7b-4b4b-8bf7-d981372cf4b0', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:28:56.258752 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:28:56.259167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:28:56.259635 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:28:56.260034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:28:56.260440 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:28:56.269066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:56.269510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:56.270337 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:56.270768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:56.287054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Getting quotas for project 38f2e257d56d477d98132d62b4f87b19. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:28:56.290854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Getting quotas for user b52ac049f28842cbb53a283a40142faf and project 38f2e257d56d477d98132d62b4f87b19. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:28:56.301817 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:28:56.304036 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:28:56.468285 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7eed1867-9f70-4352-ae57-32af2d048994 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594073 May 16 15:28:56.468936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 501/996] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:28:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:28:56.484499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-49bd8756-020a-48ee-b04d-3a8b0847b016 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:56.485118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-49bd8756-020a-48ee-b04d-3a8b0847b016 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:56.538256 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-49bd8756-020a-48ee-b04d-3a8b0847b016 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:56.549919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-49bd8756-020a-48ee-b04d-3a8b0847b016 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1213 microversion: 2.1 time: 0.065472 May 16 15:28:56.549919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 496/997] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:56 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:57.563178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:57.563941 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:57.570598 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:57.571051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:57.571826 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:57.572264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:57.640368 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:57.648485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3f0469ab-428d-4a0b-a8c1-c420575aae1c tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1209 microversion: 2.1 time: 0.090177 May 16 15:28:57.649065 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 502/998] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:57 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:58.667132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:58.667805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:58.674697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:58.675160 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:58.676755 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:58.676755 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:58.765432 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:58.772654 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-23d0ded9-275d-43f1-8a08-10a19c6d4363 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1271 microversion: 2.1 time: 0.109537 May 16 15:28:58.773410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 497/999] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:58 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:28:59.788848 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:28:59.789463 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:28:59.795843 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:59.796286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:59.797053 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:59.797485 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:59.820256 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-26bc537f-80cb-4bc0-a541-a0bf6e13b1af req-19558466-b7b9-4397-aa56-c0ad1eb95204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2240b136-4cc6-437d-82cf-b98df254a7e8", "tag": "783e67be-f0d1-40fa-aed1-77f3c96642fe"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:28:59.830067 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-26bc537f-80cb-4bc0-a541-a0bf6e13b1af req-19558466-b7b9-4397-aa56-c0ad1eb95204 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:28:59.831369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-26bc537f-80cb-4bc0-a541-a0bf6e13b1af req-19558466-b7b9-4397-aa56-c0ad1eb95204 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:28:59.852014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-26bc537f-80cb-4bc0-a541-a0bf6e13b1af req-19558466-b7b9-4397-aa56-c0ad1eb95204 service nova] Creating event network-changed:783e67be-f0d1-40fa-aed1-77f3c96642fe for instance 2240b136-4cc6-437d-82cf-b98df254a7e8 on hv-cinder-79053 May 16 15:28:59.856840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-26bc537f-80cb-4bc0-a541-a0bf6e13b1af req-19558466-b7b9-4397-aa56-c0ad1eb95204 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040304 May 16 15:28:59.857430 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 498/1000] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:28:59.933503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:28:59.942484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-faac004f-a651-4ca1-9561-2ee16f7c9455 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1313 microversion: 2.1 time: 0.157466 May 16 15:28:59.946040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 503/1001] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:28:59 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:00.960921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:00.961644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:00.967731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:00.968176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:00.968936 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:00.969370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:01.093727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:01.101034 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-9282ecdc-cf41-4c74-b80f-8cce77880998 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1313 microversion: 2.1 time: 0.144778 May 16 15:29:01.101589 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 499/1002] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:00 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:02.120345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:02.120990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:02.127935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:02.128372 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:02.129132 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:02.129560 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:02.256903 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:02.264791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d939bef9-7d44-45b5-8621-0d4e774a111b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1313 microversion: 2.1 time: 0.150260 May 16 15:29:02.265388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 504/1003] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:02 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:03.281056 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:03.281675 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:03.288027 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.288481 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.289253 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:03.289693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:03.416379 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:03.423557 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-28ff72a8-d36b-4b33-952f-415e5546c361 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1313 microversion: 2.1 time: 0.146331 May 16 15:29:03.424621 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 500/1004] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:03 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:04.440759 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:04.441379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:04.447338 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:04.447791 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:04.448597 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:04.449038 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:04.468719 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-5c66dd4a-8193-45ea-a7d4-ea443203989e req-7f6314c7-5593-429a-87e9-b08a3a2bc26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2240b136-4cc6-437d-82cf-b98df254a7e8", "name": "network-vif-plugged", "status": "completed", "tag": "783e67be-f0d1-40fa-aed1-77f3c96642fe"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:04.478638 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5c66dd4a-8193-45ea-a7d4-ea443203989e req-7f6314c7-5593-429a-87e9-b08a3a2bc26c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:04.481073 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-5c66dd4a-8193-45ea-a7d4-ea443203989e req-7f6314c7-5593-429a-87e9-b08a3a2bc26c service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:04.490859 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-5c66dd4a-8193-45ea-a7d4-ea443203989e req-7f6314c7-5593-429a-87e9-b08a3a2bc26c service nova] Creating event network-vif-plugged:783e67be-f0d1-40fa-aed1-77f3c96642fe for instance 2240b136-4cc6-437d-82cf-b98df254a7e8 on hv-cinder-79053 May 16 15:29:04.500126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-5c66dd4a-8193-45ea-a7d4-ea443203989e req-7f6314c7-5593-429a-87e9-b08a3a2bc26c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035064 May 16 15:29:04.500887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 501/1005] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:04.600507 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:04.608083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8cb29ad1-923f-4910-a550-a7f14c26d6d4 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1313 microversion: 2.1 time: 0.171502 May 16 15:29:04.608657 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 505/1006] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:04 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:05.625738 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:05.626467 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:05.632560 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:05.633008 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:05.633772 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:05.634237 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:05.764964 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:05.772585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48523e47-2c83-4738-9895-c81475606a7e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1313 microversion: 2.1 time: 0.151568 May 16 15:29:05.773140 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 502/1007] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:05 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:06.789597 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:06.790272 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:06.796674 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:06.797134 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:06.797884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:06.798350 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:06.925042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:06.932249 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c1ea4fb8-6a03-49bc-bd1f-dc398dbea6e3 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1498 microversion: 2.1 time: 0.146596 May 16 15:29:06.932809 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 506/1008] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:06 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:07.755090 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:07.755608 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:07.762439 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:07.763045 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:07.763824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:07.764268 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:07.788836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:29:08.048710 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b05c0ed4-6a0b-4c64-b6ee-2c9df2292916 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 204 len: 0 microversion: 2.1 time: 0.297751 May 16 15:29:08.049294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 503/1009] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:29:07 2022] DELETE /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:29:08.057757 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:08.059961 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:08.064914 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:08.065360 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:08.066153 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:08.066586 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:08.204984 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:08.212962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f3680b26-c921-4799-b313-bc8a139c9252 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1504 microversion: 2.1 time: 0.159160 May 16 15:29:08.213533 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 507/1010] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:08 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:09.231280 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:09.231915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:09.238829 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:09.239277 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:09.240050 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:09.240485 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:09.365211 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:09.372953 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5de1a6b7-4e87-4901-9a58-5e0c26b65b6b tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1504 microversion: 2.1 time: 0.145991 May 16 15:29:09.373525 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 504/1011] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:09 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:10.045480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-e7fc4286-a548-4a3f-b9e2-d3ea15431e1e req-c7f5a289-896e-4a1b-8856-2be32d793c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2240b136-4cc6-437d-82cf-b98df254a7e8", "name": "network-vif-deleted", "tag": "783e67be-f0d1-40fa-aed1-77f3c96642fe"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:10.054388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e7fc4286-a548-4a3f-b9e2-d3ea15431e1e req-c7f5a289-896e-4a1b-8856-2be32d793c7d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:10.054837 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-e7fc4286-a548-4a3f-b9e2-d3ea15431e1e req-c7f5a289-896e-4a1b-8856-2be32d793c7d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:10.066632 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-e7fc4286-a548-4a3f-b9e2-d3ea15431e1e req-c7f5a289-896e-4a1b-8856-2be32d793c7d service nova] Creating event network-vif-deleted:783e67be-f0d1-40fa-aed1-77f3c96642fe for instance 2240b136-4cc6-437d-82cf-b98df254a7e8 on hv-cinder-79053 May 16 15:29:10.072092 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-e7fc4286-a548-4a3f-b9e2-d3ea15431e1e req-c7f5a289-896e-4a1b-8856-2be32d793c7d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030313 May 16 15:29:10.072687 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 508/1012] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:10.389080 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:10.389705 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:10.396194 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:10.396651 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:10.397429 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:10.397872 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:10.428849 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:10.429552 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:10.430091 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lazy-loading 'fault' on Instance uuid 2240b136-4cc6-437d-82cf-b98df254a7e8 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:29:10.469623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ac049f28842cbb53a283a40142faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f2e257d56d477d98132d62b4f87b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:10.477269 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-06d73f6d-ea9b-4ecf-bc5d-acaebdb73c3e tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 200 len: 1303 microversion: 2.1 time: 0.092355 May 16 15:29:10.477829 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 505/1013] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:10 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:11.495365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:11.496146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] [instance: 2240b136-4cc6-437d-82cf-b98df254a7e8] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:11.502411 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:11.502862 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:11.503696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:11.504137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:11.517760 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] HTTP exception thrown: Instance 2240b136-4cc6-437d-82cf-b98df254a7e8 could not be found. May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Request method failure captured: May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 HTTP/1.1 May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2h8-QAWxX0RVgIyu9XlnAGe0Wlnc9lvs3XHqNATK54-lVPf3LmbRdN9JFN0EaO_4il-wZ6IlU4u6pjLASBhNwxobNWHIpzbCxvu3JUAn4zN68ksaa1JmHX3UzthQwnf7RTYo3nSQjfW2FB9crJgeV77XAceaiUpm0FhpbfFhU8T9Y May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: 38f2e257d56d477d98132d62b4f87b19 May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesActionsTest-841429724 May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:29:11.519086 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/38f2e257d56d477d98132d62b4f87b19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_38f2e257d56d477d98132d62b4f87b19", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38f2e257d56d477d98132d62b4f87b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/38f2e257d56d477d98132d62b4f87b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesActionsTest-841429724 May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: 38f2e257d56d477d98132d62b4f87b19 May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesActionsTest-841429724 May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesActionsTest-841429724-project May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: b52ac049f28842cbb53a283a40142faf May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesActionsTest-841429724-project May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 2240b136-4cc6-437d-82cf-b98df254a7e8 could not be found. May 16 15:29:11.520611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '2240b136-4cc6-437d-82cf-b98df254a7e8'} May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2240b136-4cc6-437d-82cf-b98df254a7e8 could not be found. May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:11.521755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2240b136-4cc6-437d-82cf-b98df254a7e8 could not be found. May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2240b136-4cc6-437d-82cf-b98df254a7e8 could not be found. May 16 15:29:11.530332 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:11.533423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] Returning 404 to user: Instance 2240b136-4cc6-437d-82cf-b98df254a7e8 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:11.533423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d53ee4c5-bdad-4e29-8bb3-e8e2e6855bf2 tempest-VolumesActionsTest-841429724 tempest-VolumesActionsTest-841429724-project] 10.222.0.76 "GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8" status: 404 len: 111 microversion: 2.1 time: 0.030035 May 16 15:29:11.533423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 509/1014] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:11 2022] GET /compute/v2.1/servers/2240b136-4cc6-437d-82cf-b98df254a7e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:29:21.942602 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1d847878-6023-4a6d-91a3-5b6fc0907f07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:21.943794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1d847878-6023-4a6d-91a3-5b6fc0907f07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:21.950390 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d847878-6023-4a6d-91a3-5b6fc0907f07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:21.951084 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d847878-6023-4a6d-91a3-5b6fc0907f07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:21.952035 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d847878-6023-4a6d-91a3-5b6fc0907f07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:21.952628 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1d847878-6023-4a6d-91a3-5b6fc0907f07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:21.983609 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1d847878-6023-4a6d-91a3-5b6fc0907f07 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045844 May 16 15:29:21.988951 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 506/1015] 10.222.0.76 () {60 vars in 1342 bytes} [Mon May 16 15:29:21 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:29:22.047503 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:22.048035 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:22.055327 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:22.055958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:22.056892 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:22.057321 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:22.093206 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:29:22.365525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fce8cf99-ef38-4fb3-be65-3b78f2fd31db tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 204 len: 0 microversion: 2.20 time: 0.321667 May 16 15:29:22.366378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 510/1016] 10.222.0.76 () {60 vars in 1279 bytes} [Mon May 16 15:29:22 2022] DELETE /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:29:22.377109 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:22.378332 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:22.385224 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:22.385558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:22.386369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:22.386809 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:22.530348 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:22.540133 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:22.542161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:22.543464 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-377ae42d-501d-449c-9990-c5285a14dceb tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.171117 May 16 15:29:22.544050 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 507/1017] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:29:22 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:29:23.565547 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:23.566982 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:23.573744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:23.574318 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:23.575254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:23.575743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:23.741891 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:23.753652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:23.755365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:23.756606 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-11839b38-6dbd-4c83-b0d9-c9878df42583 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1723 microversion: 2.20 time: 0.195490 May 16 15:29:23.757162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 511/1018] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:29:23 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:29:24.776802 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:24.777595 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:24.790507 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:24.791062 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:24.792166 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:24.792672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:24.924389 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:24.942234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:24.944725 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:24.946229 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-61652915-6240-4f79-81f3-71fad78960ca tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1655 microversion: 2.20 time: 0.174312 May 16 15:29:24.957654 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 508/1019] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:29:24 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1655 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:29:25.222415 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-3d157dbb-49da-4f25-b4b4-3ed84f81c051 req-72cc0dfa-f674-450b-a4f3-d9c44649bdcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3d7e6a-43dc-42b0-a663-56ad894c3801", "name": "network-vif-deleted", "tag": "588be31f-e001-4d2f-97c9-ef1bb2eeef86"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:25.232715 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3d157dbb-49da-4f25-b4b4-3ed84f81c051 req-72cc0dfa-f674-450b-a4f3-d9c44649bdcb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:25.233168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-3d157dbb-49da-4f25-b4b4-3ed84f81c051 req-72cc0dfa-f674-450b-a4f3-d9c44649bdcb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:25.247116 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-3d157dbb-49da-4f25-b4b4-3ed84f81c051 req-72cc0dfa-f674-450b-a4f3-d9c44649bdcb service nova] Creating event network-vif-deleted:588be31f-e001-4d2f-97c9-ef1bb2eeef86 for instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 on hv-cinder-79053 May 16 15:29:25.252787 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-3d157dbb-49da-4f25-b4b4-3ed84f81c051 req-72cc0dfa-f674-450b-a4f3-d9c44649bdcb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035500 May 16 15:29:25.258789 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 512/1020] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:29:25.965186 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:25.965725 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:25.972020 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:25.976384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:25.976384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:25.976384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:26.014842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:26.014842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:26.014842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lazy-loading 'fault' on Instance uuid 1a3d7e6a-43dc-42b0-a663-56ad894c3801 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:29:26.064919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:26.073481 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:26.075152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3492cec550a46598e09c48474a4c6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2241c9641bb401aa9f1c6930c513552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:26.076733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6006d5cd-1ac0-4426-8ec3-a39d933ac152 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 200 len: 1371 microversion: 2.20 time: 0.115876 May 16 15:29:26.077209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 509/1021] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:29:25 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 16 15:29:27.104861 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:27.106247 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:27.112990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:27.114286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:27.115231 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:27.115661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:27.130472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] HTTP exception thrown: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Request method failure captured: May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 HTTP/1.1 May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv4FdfzLyRfu0uocicFba-ELCXfeFUNI9sKlOs_EFkIu_MCGtsXboehV9qdvk6KAMBtJxnrHmw9aVLQCMACryB8OTBk6RMQIEaABTgurA4Avd0MEwk7iwOmm907YGTkq18FT3i4AhvGxXKMjt-MdBbyjPHeF4mxQQcikYoWOey6yUg May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:29:27.132176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f2241c9641bb401aa9f1c6930c513552", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: d3492cec550a46598e09c48474a4c6fb May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:27.133703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '1a3d7e6a-43dc-42b0-a663-56ad894c3801'} May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:27.134783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:27.136279 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:27.138566 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Returning 404 to user: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:27.139482 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cd20da5f-8c6b-410b-b4a4-09790111ecb1 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 404 len: 111 microversion: 2.20 time: 0.039642 May 16 15:29:27.140033 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 513/1022] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:29:27 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:29:27.148975 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d78b0e64-10c8-4910-bc52-448d22a6b013 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '.version_select at 0x7fddb3b89d30>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:27.273589 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d78b0e64-10c8-4910-bc52-448d22a6b013 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483001783" status: 204 len: 0 microversion: 2.20 time: 0.128449 May 16 15:29:27.274287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 510/1023] 10.222.0.76 () {60 vars in 1258 bytes} [Mon May 16 15:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483001783 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 16 15:29:29.803181 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:29.804315 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:29.811034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:29.811744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:29.812714 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:29.813361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:29.829983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] HTTP exception thrown: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Request method failure captured: May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 HTTP/1.1 May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv4FdfzLyRfu0uocicFba-ELCXfeFUNI9sKlOs_EFkIu_MCGtsXboehV9qdvk6KAMBtJxnrHmw9aVLQCMACryB8OTBk6RMQIEaABTgurA4Avd0MEwk7iwOmm907YGTkq18FT3i4AhvGxXKMjt-MdBbyjPHeF4mxQQcikYoWOey6yUg May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:29:29.831675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f2241c9641bb401aa9f1c6930c513552", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: d3492cec550a46598e09c48474a4c6fb May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.834040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '1a3d7e6a-43dc-42b0-a663-56ad894c3801'} May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:29.835003 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.836602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:29.838160 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Returning 404 to user: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:29.838792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-97fb7beb-7722-47e0-9d29-657c2d92bfb5 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 404 len: 111 microversion: 2.20 time: 0.037399 May 16 15:29:29.839208 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 514/1024] 10.222.0.76 () {60 vars in 1279 bytes} [Mon May 16 15:29:29 2022] DELETE /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:29:29.849372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:29.850000 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 1a3d7e6a-43dc-42b0-a663-56ad894c3801] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:29.857012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:29.857557 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:29.858539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:29.859246 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:29.878116 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] HTTP exception thrown: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Request method failure captured: May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 HTTP/1.1 May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmv4FdfzLyRfu0uocicFba-ELCXfeFUNI9sKlOs_EFkIu_MCGtsXboehV9qdvk6KAMBtJxnrHmw9aVLQCMACryB8OTBk6RMQIEaABTgurA4Avd0MEwk7iwOmm907YGTkq18FT3i4AhvGxXKMjt-MdBbyjPHeF4mxQQcikYoWOey6yUg May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:29:29.881358 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f2241c9641bb401aa9f1c6930c513552", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: d3492cec550a46598e09c48474a4c6fb May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.883111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '1a3d7e6a-43dc-42b0-a663-56ad894c3801'} May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:29.884041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. May 16 15:29:29.885510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:29.886822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Returning 404 to user: Instance 1a3d7e6a-43dc-42b0-a663-56ad894c3801 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:29.886822 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d242b9ff-d40e-4d58-995c-fcf3de72f137 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801" status: 404 len: 111 microversion: 2.20 time: 0.039998 May 16 15:29:29.889546 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 511/1025] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:29:29 2022] GET /compute/v2.1/servers/1a3d7e6a-43dc-42b0-a663-56ad894c3801 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:29:31.200028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:31.200562 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:31.207264 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:31.207991 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:31.209049 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:31.209683 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:31.224620 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] HTTP exception thrown: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Request method failure captured: May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 HTTP/1.1 May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigmv4FdfzLyRfu0uocicFba-ELCXfeFUNI9sKlOs_EFkIu_MCGtsXboehV9qdvk6KAMBtJxnrHmw9aVLQCMACryB8OTBk6RMQIEaABTgurA4Avd0MEwk7iwOmm907YGTkq18FT3i4AhvGxXKMjt-MdBbyjPHeF4mxQQcikYoWOey6yUg May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:29:31.226457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f2241c9641bb401aa9f1c6930c513552", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: d3492cec550a46598e09c48474a4c6fb May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.227870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '031f5d91-18aa-47bd-a848-e09d19e8f6c4'} May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:31.228634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.229885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:31.231168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Returning 404 to user: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:31.231168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3a8025a4-ffe4-4d4a-88d3-81b295fd67d2 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "DELETE /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 404 len: 111 microversion: 2.20 time: 0.031754 May 16 15:29:31.231168 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 515/1026] 10.222.0.76 () {60 vars in 1279 bytes} [Mon May 16 15:29:31 2022] DELETE /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:29:31.236915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:31.237528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] [instance: 031f5d91-18aa-47bd-a848-e09d19e8f6c4] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:31.244882 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:31.245336 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:31.246112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:31.246570 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:31.260876 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] HTTP exception thrown: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Request method failure captured: May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 HTTP/1.1 May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmv4FdfzLyRfu0uocicFba-ELCXfeFUNI9sKlOs_EFkIu_MCGtsXboehV9qdvk6KAMBtJxnrHmw9aVLQCMACryB8OTBk6RMQIEaABTgurA4Avd0MEwk7iwOmm907YGTkq18FT3i4AhvGxXKMjt-MdBbyjPHeF4mxQQcikYoWOey6yUg May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Openstack-Nova-Api-Version: 2.20 May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:29:31.262455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f2241c9641bb401aa9f1c6930c513552", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f2241c9641bb401aa9f1c6930c513552"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: f2241c9641bb401aa9f1c6930c513552 May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1313645631 May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: d3492cec550a46598e09c48474a4c6fb May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1313645631-project May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.264161 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '031f5d91-18aa-47bd-a848-e09d19e8f6c4'} May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:31.264915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. May 16 15:29:31.266327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:31.267700 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] Returning 404 to user: Instance 031f5d91-18aa-47bd-a848-e09d19e8f6c4 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:31.267700 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-72cba3e3-8ab8-4cd3-b92a-004d25706f34 tempest-AttachVolumeShelveTestJSON-1313645631 tempest-AttachVolumeShelveTestJSON-1313645631-project] 10.222.0.76 "GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4" status: 404 len: 111 microversion: 2.20 time: 0.031245 May 16 15:29:31.267700 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 512/1027] 10.222.0.76 () {60 vars in 1276 bytes} [Mon May 16 15:29:31 2022] GET /compute/v2.1/servers/031f5d91-18aa-47bd-a848-e09d19e8f6c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 16 15:29:35.474692 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-43f1c874-19c1-489e-b9ea-e2283f147272 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:35.475302 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-43f1c874-19c1-489e-b9ea-e2283f147272 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:35.481303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43f1c874-19c1-489e-b9ea-e2283f147272 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:35.481881 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43f1c874-19c1-489e-b9ea-e2283f147272 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:35.482681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43f1c874-19c1-489e-b9ea-e2283f147272 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:35.483120 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43f1c874-19c1-489e-b9ea-e2283f147272 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:35.507987 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-43f1c874-19c1-489e-b9ea-e2283f147272 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/ips" status: 200 len: 148 microversion: 2.1 time: 0.036942 May 16 15:29:35.510443 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 516/1028] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:29:35 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:36.903415 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94364006-b6d1-47e8-8471-eae3de8941d3 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Action: 'create', calling method: .version_select at 0x7fddb3b80f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-559638134"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:37.296661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-34179cff-e573-40a0-b8d4-b41acebece70 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa5e3cc3-e677-4095-9a18-eb22d8b426a1"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:37.298036 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-34179cff-e573-40a0-b8d4-b41acebece70 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:37.305367 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34179cff-e573-40a0-b8d4-b41acebece70 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:37.305637 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34179cff-e573-40a0-b8d4-b41acebece70 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:37.306396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34179cff-e573-40a0-b8d4-b41acebece70 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:37.306834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34179cff-e573-40a0-b8d4-b41acebece70 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:37.595559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94364006-b6d1-47e8-8471-eae3de8941d3 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.808287 May 16 15:29:37.596182 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 513/1029] 10.222.0.76 () {60 vars in 1154 bytes} [Mon May 16 15:29:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 810 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 16 15:29:37.607525 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d56381e0-7af6-4c40-93ae-688f0b1115d2 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3b65d30>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:37.654881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d56381e0-7af6-4c40-93ae-688f0b1115d2 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074" status: 200 len: 344 microversion: 2.1 time: 0.051343 May 16 15:29:37.655653 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 514/1030] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:29:37 2022] GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:38.088977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-34179cff-e573-40a0-b8d4-b41acebece70 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796195 May 16 15:29:38.089709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 517/1031] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:29:37 2022] POST /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:29:38.668031 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f8ca4c3d-55a1-47a4-a41d-2abd5d0f0036 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3c8c550>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:38.714723 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f8ca4c3d-55a1-47a4-a41d-2abd5d0f0036 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074" status: 200 len: 345 microversion: 2.1 time: 0.051169 May 16 15:29:38.715288 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 515/1032] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:29:38 2022] GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:38.727427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-0dfb26f1-ee8a-4bbb-a611-acbf755dc03f tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Action: 'create', calling method: .version_select at 0x7fddb3d56820>, body: {"snapshot": {"volume_id": "d826e170-8aa4-4487-978a-b3b65b9b4074", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1043616445"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:39.108552 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-0dfb26f1-ee8a-4bbb-a611-acbf755dc03f tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.385694 May 16 15:29:39.109166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 518/1033] 10.222.0.76 () {60 vars in 1161 bytes} [Mon May 16 15:29:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:39.119003 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5a622daa-8013-41c3-9933-0d92325d68ce tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3b80430>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:39.154229 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5a622daa-8013-41c3-9933-0d92325d68ce tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 200 len: 287 microversion: 2.1 time: 0.038847 May 16 15:29:39.159965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 516/1034] 10.222.0.76 () {58 vars in 1250 bytes} [Mon May 16 15:29:39 2022] GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:39.165037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-760fc276-49d2-494f-adae-a9f536499448 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3ef8040>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:39.203934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-760fc276-49d2-494f-adae-a9f536499448 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033951 May 16 15:29:39.203934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 519/1035] 10.222.0.76 () {58 vars in 1139 bytes} [Mon May 16 15:29:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:29:39.210328 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2932571d-7565-4ac3-8070-e5829c895198 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3b65820>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:39.241180 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2932571d-7565-4ac3-8070-e5829c895198 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 200 len: 287 microversion: 2.1 time: 0.035264 May 16 15:29:39.241746 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 517/1036] 10.222.0.76 () {58 vars in 1250 bytes} [Mon May 16 15:29:39 2022] GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:40.173442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:40.174205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:40.179060 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-3c6b0590-1a93-47b8-8fbd-bfe656f73e7c req-9abceb5c-96b7-42ce-94e8-907b0457953d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e9b501-f7d9-4696-a6c2-c1930221431a", "tag": "63eb5f5f-0157-446b-b8eb-bc09b2fc4125"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:40.183625 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:40.184144 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:40.185217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:40.187980 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:40.188246 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3c6b0590-1a93-47b8-8fbd-bfe656f73e7c req-9abceb5c-96b7-42ce-94e8-907b0457953d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:40.189160 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-3c6b0590-1a93-47b8-8fbd-bfe656f73e7c req-9abceb5c-96b7-42ce-94e8-907b0457953d service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:40.201082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-3c6b0590-1a93-47b8-8fbd-bfe656f73e7c req-9abceb5c-96b7-42ce-94e8-907b0457953d service nova] Creating event network-changed:63eb5f5f-0157-446b-b8eb-bc09b2fc4125 for instance 26e9b501-f7d9-4696-a6c2-c1930221431a on hv-cinder-79053 May 16 15:29:40.207991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-3c6b0590-1a93-47b8-8fbd-bfe656f73e7c req-9abceb5c-96b7-42ce-94e8-907b0457953d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 May 16 15:29:40.208714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 518/1037] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:40.212563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:29:40.254426 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94c21596-6443-44e4-bb94-f778be20af99 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3b650d0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:40.285510 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94c21596-6443-44e4-bb94-f778be20af99 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 200 len: 287 microversion: 2.1 time: 0.036072 May 16 15:29:40.286212 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 519/1038] 10.222.0.76 () {58 vars in 1250 bytes} [Mon May 16 15:29:40 2022] GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:40.514000 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-07559d4c-b947-45ed-afe5-b841195e8d89 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "DELETE /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 204 len: 0 microversion: 2.1 time: 0.344363 May 16 15:29:40.514634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 520/1039] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:29:40 2022] DELETE /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:29:40.523001 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:40.523992 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:40.530830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:40.531294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:40.532486 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:40.533264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:40.671797 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:40.679811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d6c8250b-2751-4af6-adcf-7b9256a56117 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.160789 May 16 15:29:40.680374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 520/1040] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:40 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:41.297205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1e205236-beca-416e-ab62-7a2d941c12c9 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddc0976b80>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:41.326944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1e205236-beca-416e-ab62-7a2d941c12c9 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 200 len: 287 microversion: 2.1 time: 0.033896 May 16 15:29:41.327514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 521/1041] 10.222.0.76 () {58 vars in 1250 bytes} [Mon May 16 15:29:41 2022] GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:41.697737 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:41.698387 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:41.704399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:41.704854 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:41.705636 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:41.706080 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:41.829692 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:41.837099 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-84096bf0-2fde-4280-9c25-96aad7e02f48 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.144063 May 16 15:29:41.837669 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 521/1042] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:41 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:42.339502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3fd105c2-9a1e-402f-99cf-bcc97e9e5ad0 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3ef81f0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:42.369720 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3fd105c2-9a1e-402f-99cf-bcc97e9e5ad0 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 200 len: 288 microversion: 2.1 time: 0.034566 May 16 15:29:42.371137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 522/1043] 10.222.0.76 () {58 vars in 1250 bytes} [Mon May 16 15:29:42 2022] GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:42.380379 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-75850a98-7c17-45e8-8aef-8a979e4118fc tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3cf24c0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:42.468036 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-75850a98-7c17-45e8-8aef-8a979e4118fc tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 202 len: 0 microversion: 2.1 time: 0.091395 May 16 15:29:42.468628 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 522/1044] 10.222.0.76 () {58 vars in 1253 bytes} [Mon May 16 15:29:42 2022] DELETE /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:29:42.477570 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-77318e4b-a9da-4408-b828-5886a68ce99e tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3d56af0>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:42.505925 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-77318e4b-a9da-4408-b828-5886a68ce99e tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 200 len: 287 microversion: 2.1 time: 0.032874 May 16 15:29:42.506515 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 523/1045] 10.222.0.76 () {58 vars in 1250 bytes} [Mon May 16 15:29:42 2022] GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:42.854116 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:42.854680 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:42.860616 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:42.861066 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:42.861831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:42.862303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:42.993570 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:43.000866 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bf0d0a9d-e21a-4d28-ac72-0211eed7d70e tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.151381 May 16 15:29:43.001425 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 523/1046] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:42 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:43.518328 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be1060d3-2512-43ce-ba77-aca5671a188b tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3ef0a60>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:43.542523 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-be1060d3-2512-43ce-ba77-aca5671a188b tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] HTTP exception thrown: Snapshot ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 could not be found. May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be1060d3-2512-43ce-ba77-aca5671a188b tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Request method failure captured: May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 HTTP/1.1 May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm3gvlubQOBgQxUmwDikCcJG89U6RK31-DwgCEQsfsl3CHGsv2-lxzKRJ04eR7_Db2Zk6cQPA5PPW7x7NVKCGuqdIvI1J_Zf1RkS-ssskkZj0zGXSNtm4dEPH5No8ATY6BRQiatYL-nLuHbvLeqz8JP9AtTB_jun3RSdmkZnKXkr2ao May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:29:43.544821 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a29c645b0e414196fd433f2c6fa249", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: ce393968514a4579bfcb113a893ad4a4 May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Snapshot ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 could not be found. May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'ccce4cd1-d098-4a95-ae5c-c227ad24b2a3'} May 16 15:29:43.546516 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 could not be found. (HTTP 404) (Request-ID: req-9e18fdc6-0c79-4a43-9485-bc89dc63f8b3) May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:43.547583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:29:43.548948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 could not be found. May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 16 15:29:43.550429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 could not be found. May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 could not be found. May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-be1060d3-2512-43ce-ba77-aca5671a188b tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Returning 404 to user: Snapshot ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:43.552576 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-be1060d3-2512-43ce-ba77-aca5671a188b tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3" status: 404 len: 111 microversion: 2.1 time: 0.032539 May 16 15:29:43.553612 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 524/1047] 10.222.0.76 () {58 vars in 1250 bytes} [Mon May 16 15:29:43 2022] GET /compute/v2.1/os-snapshots/ccce4cd1-d098-4a95-ae5c-c227ad24b2a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:29:43.558076 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bb0802c8-272e-4246-81a3-f8f006f8aba2 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3d54430>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:43.747486 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bb0802c8-272e-4246-81a3-f8f006f8aba2 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074" status: 202 len: 0 microversion: 2.1 time: 0.193220 May 16 15:29:43.748267 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 524/1048] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:29:43 2022] DELETE /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:29:43.757657 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-23e6d63f-b97f-4e3d-9c1c-b8449cb437a3 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3e88e50>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:43.802960 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-23e6d63f-b97f-4e3d-9c1c-b8449cb437a3 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074" status: 200 len: 344 microversion: 2.1 time: 0.050231 May 16 15:29:43.803522 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 525/1049] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:29:43 2022] GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:44.019879 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:44.021056 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:44.026974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:44.027420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:44.028187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:44.028625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:44.179924 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:44.187480 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-18862de6-c382-4464-b07e-d194448f1ac4 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1566 microversion: 2.1 time: 0.173178 May 16 15:29:44.188040 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 525/1050] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:44 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:44.816212 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9900187e-532e-4579-9618-20c3338efe83 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3d56670>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:44.821352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-4d7e1c8c-d67d-41a8-802e-4f2dde4b4da3 req-127148bf-3add-431f-b30d-c82f173db931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e9b501-f7d9-4696-a6c2-c1930221431a", "name": "network-vif-deleted", "tag": "63eb5f5f-0157-446b-b8eb-bc09b2fc4125"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:44.834553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-4d7e1c8c-d67d-41a8-802e-4f2dde4b4da3 req-127148bf-3add-431f-b30d-c82f173db931 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:44.835537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-4d7e1c8c-d67d-41a8-802e-4f2dde4b4da3 req-127148bf-3add-431f-b30d-c82f173db931 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:44.846915 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-9900187e-532e-4579-9618-20c3338efe83 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] HTTP exception thrown: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.847120 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-4d7e1c8c-d67d-41a8-802e-4f2dde4b4da3 req-127148bf-3add-431f-b30d-c82f173db931 service nova] Creating event network-vif-deleted:63eb5f5f-0157-446b-b8eb-bc09b2fc4125 for instance 26e9b501-f7d9-4696-a6c2-c1930221431a on hv-cinder-79053 May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9900187e-532e-4579-9618-20c3338efe83 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Request method failure captured: May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 HTTP/1.1 May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm3gvlubQOBgQxUmwDikCcJG89U6RK31-DwgCEQsfsl3CHGsv2-lxzKRJ04eR7_Db2Zk6cQPA5PPW7x7NVKCGuqdIvI1J_Zf1RkS-ssskkZj0zGXSNtm4dEPH5No8ATY6BRQiatYL-nLuHbvLeqz8JP9AtTB_jun3RSdmkZnKXkr2ao May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:29:44.848913 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a29c645b0e414196fd433f2c6fa249", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: ce393968514a4579bfcb113a893ad4a4 May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'd826e170-8aa4-4487-978a-b3b65b9b4074'} May 16 15:29:44.852711 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. (HTTP 404) (Request-ID: req-2cbd7873-d5a8-4787-bb86-f4bca35761c1) May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.853518 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:29:44.855550 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:29:44.856705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9900187e-532e-4579-9618-20c3338efe83 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Returning 404 to user: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9900187e-532e-4579-9618-20c3338efe83 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074" status: 404 len: 109 microversion: 2.1 time: 0.039271 May 16 15:29:44.858261 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 526/1051] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:29:44 2022] GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:29:44.859181 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-4d7e1c8c-d67d-41a8-802e-4f2dde4b4da3 req-127148bf-3add-431f-b30d-c82f173db931 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036071 May 16 15:29:44.859181 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 526/1052] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:29:44.867554 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7c69b1a2-1b8f-4dc9-8ebe-599c87833f17 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddc4e7d160>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:44.895681 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-7c69b1a2-1b8f-4dc9-8ebe-599c87833f17 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] HTTP exception thrown: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7c69b1a2-1b8f-4dc9-8ebe-599c87833f17 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Request method failure captured: May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 HTTP/1.1 May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm3gvlubQOBgQxUmwDikCcJG89U6RK31-DwgCEQsfsl3CHGsv2-lxzKRJ04eR7_Db2Zk6cQPA5PPW7x7NVKCGuqdIvI1J_Zf1RkS-ssskkZj0zGXSNtm4dEPH5No8ATY6BRQiatYL-nLuHbvLeqz8JP9AtTB_jun3RSdmkZnKXkr2ao May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:29:44.898934 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a29c645b0e414196fd433f2c6fa249", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: ce393968514a4579bfcb113a893ad4a4 May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'd826e170-8aa4-4487-978a-b3b65b9b4074'} May 16 15:29:44.905812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. (HTTP 404) (Request-ID: req-fd4a8839-324d-42ae-a144-885d62264d6a) May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.906804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 16 15:29:44.908172 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 16 15:29:44.909479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7c69b1a2-1b8f-4dc9-8ebe-599c87833f17 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Returning 404 to user: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7c69b1a2-1b8f-4dc9-8ebe-599c87833f17 tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074" status: 404 len: 109 microversion: 2.1 time: 0.036683 May 16 15:29:44.910866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 527/1053] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:29:44 2022] DELETE /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:29:44.911915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d9b4d4ce-0b77-47f1-9bdf-e79ca18475ce tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Calling method '.version_select at 0x7fddb3d54dc0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:44.938047 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-d9b4d4ce-0b77-47f1-9bdf-e79ca18475ce tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] HTTP exception thrown: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d9b4d4ce-0b77-47f1-9bdf-e79ca18475ce tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Request method failure captured: May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 HTTP/1.1 May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm3gvlubQOBgQxUmwDikCcJG89U6RK31-DwgCEQsfsl3CHGsv2-lxzKRJ04eR7_Db2Zk6cQPA5PPW7x7NVKCGuqdIvI1J_Zf1RkS-ssskkZj0zGXSNtm4dEPH5No8ATY6BRQiatYL-nLuHbvLeqz8JP9AtTB_jun3RSdmkZnKXkr2ao May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:29:44.940259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8a29c645b0e414196fd433f2c6fa249", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8a29c645b0e414196fd433f2c6fa249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: b8a29c645b0e414196fd433f2c6fa249 May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297116149 May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: ce393968514a4579bfcb113a893ad4a4 May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297116149-project May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': 'd826e170-8aa4-4487-978a-b3b65b9b4074'} May 16 15:29:44.941811 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. (HTTP 404) (Request-ID: req-975f2baf-c622-4c50-913c-073c9dde4a5e) May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.942794 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi item = cinderclient( May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 16 15:29:44.944128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 16 15:29:44.945906 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d9b4d4ce-0b77-47f1-9bdf-e79ca18475ce tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] Returning 404 to user: Volume d826e170-8aa4-4487-978a-b3b65b9b4074 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d9b4d4ce-0b77-47f1-9bdf-e79ca18475ce tempest-VolumesSnapshotsTestJSON-297116149 tempest-VolumesSnapshotsTestJSON-297116149-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074" status: 404 len: 109 microversion: 2.1 time: 0.036673 May 16 15:29:44.947335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 527/1054] 10.222.0.76 () {58 vars in 1244 bytes} [Mon May 16 15:29:44 2022] GET /compute/v2.1/os-volumes/d826e170-8aa4-4487-978a-b3b65b9b4074 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:29:45.204938 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:45.205755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:45.212593 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:45.219630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:45.219630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:45.219630 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:45.287322 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:45.294812 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ad8af110-dfd0-4619-a98a-fbc0e495711a tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1217 microversion: 2.1 time: 0.093920 May 16 15:29:45.295365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 528/1055] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:45 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:45.598517 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a8bd116f-8c04-4a87-9218-b4b9103d6fb8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: .version_select at 0x7fddb3c409d0>, body: {"keypair": {"name": "tempest-keypair-2112321251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj1QwYSNh48M2kOrZs81tpbKvc62J/5mErNu+KB4XYB45dtwPv2FVROksmAB7plWOEodrkSAB0C/KIMFV9nE81B1U99R+Re4gjYPILuzfT1Ns18bYEFBanWYJSPMiX8iQ=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:45.621352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a8bd116f-8c04-4a87-9218-b4b9103d6fb8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:29:45.627543 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-a8bd116f-8c04-4a87-9218-b4b9103d6fb8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:29:45.778309 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a8bd116f-8c04-4a87-9218-b4b9103d6fb8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184467 May 16 15:29:45.778799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 528/1056] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:29:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:46.311353 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:46.311963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:46.318652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:46.319105 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:46.319885 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:46.320328 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:46.354686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:46.355137 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:46.355587 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lazy-loading 'fault' on Instance uuid 26e9b501-f7d9-4696-a6c2-c1930221431a {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:29:46.401782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5035b142903440768a5cf79d47fc0d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be817fd143aa4f3b87f6cfd77666cdb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:46.410144 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-91162529-1f6b-4430-b9a5-74671268b4ab tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 200 len: 1222 microversion: 2.1 time: 0.102325 May 16 15:29:46.411050 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 529/1057] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:46 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:47.427670 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:47.428411 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] [instance: 26e9b501-f7d9-4696-a6c2-c1930221431a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:47.435192 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:47.435761 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:47.436551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:47.436991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:47.450629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] HTTP exception thrown: Instance 26e9b501-f7d9-4696-a6c2-c1930221431a could not be found. May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Request method failure captured: May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a HTTP/1.1 May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigmyO2FjtqRTj5UAAZU3tMBk8Q-Airepy17iDA-Mm01dYEcXzA8468mvJuWc0644Th_cMFXbPWGmAPOqaMYJnX0wGQTq_3Ii839UPyjGx8HqU_hDMJambg7v3sBYw3UoqHI3brPoGiLyRfkTzCDvPoZbN8ijIyfseXDU6yQS01LMLxf0 May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: be817fd143aa4f3b87f6cfd77666cdb7 May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestShelveInstance-504826177 May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:29:47.452190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/be817fd143aa4f3b87f6cfd77666cdb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_be817fd143aa4f3b87f6cfd77666cdb7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/be817fd143aa4f3b87f6cfd77666cdb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/be817fd143aa4f3b87f6cfd77666cdb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestShelveInstance-504826177 May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: be817fd143aa4f3b87f6cfd77666cdb7 May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestShelveInstance-504826177 May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-TestShelveInstance-504826177-project May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 5035b142903440768a5cf79d47fc0d91 May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestShelveInstance-504826177-project May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 26e9b501-f7d9-4696-a6c2-c1930221431a could not be found. May 16 15:29:47.453815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '26e9b501-f7d9-4696-a6c2-c1930221431a'} May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e9b501-f7d9-4696-a6c2-c1930221431a could not be found. May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:29:47.454716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e9b501-f7d9-4696-a6c2-c1930221431a could not be found. May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e9b501-f7d9-4696-a6c2-c1930221431a could not be found. May 16 15:29:47.455970 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:29:47.457124 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Returning 404 to user: Instance 26e9b501-f7d9-4696-a6c2-c1930221431a could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:29:47.457124 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-1ea92ef7-409b-4d4f-9a98-4a5f210878d2 tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a" status: 404 len: 111 microversion: 2.1 time: 0.030437 May 16 15:29:47.457124 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 529/1058] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:47 2022] GET /compute/v2.1/servers/26e9b501-f7d9-4696-a6c2-c1930221431a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:29:47.758536 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-273c6cc9-5632-42c5-acf9-4d7a51b46c9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] Calling method '.version_select at 0x7fddc4e6e790>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:47.829632 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-273c6cc9-5632-42c5-acf9-4d7a51b46c9c tempest-TestShelveInstance-504826177 tempest-TestShelveInstance-504826177-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-43022156" status: 202 len: 0 microversion: 2.1 time: 0.074956 May 16 15:29:47.830427 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 530/1059] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-43022156 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:29:48.387248 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097649598", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97880a2a-e2c5-4ee9-b5cd-302158bacf22"}], "security_groups": [{"name": "tempest-securitygroup--1860358769"}], "key_name": "tempest-keypair-2112321251", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:48.549574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] validate_networks() for [('97880a2a-e2c5-4ee9-b5cd-302158bacf22', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:29:49.170494 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:29:49.170915 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:29:49.171389 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:29:49.171797 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:29:49.172497 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:29:49.181577 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:49.182046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:49.182880 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:49.183318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:49.200228 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:29:49.204117 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:29:49.215530 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:29:49.217803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:29:49.327473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-81206869-b72f-4326-b971-2807cf814daa tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.944905 May 16 15:29:49.328513 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 530/1060] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:29:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:29:49.339193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9ffc0e10-6c7a-4e90-8be2-14dc5d825683 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:49.340021 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9ffc0e10-6c7a-4e90-8be2-14dc5d825683 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:49.405299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9ffc0e10-6c7a-4e90-8be2-14dc5d825683 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:49.414306 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9ffc0e10-6c7a-4e90-8be2-14dc5d825683 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1242 microversion: 2.1 time: 0.079286 May 16 15:29:49.424568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 531/1061] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:49 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:50.437189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:50.444978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:50.460207 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:50.460659 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:50.461752 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:50.462399 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:50.551713 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:50.560817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a4755c4c-1fbc-4676-bb13-3dd4886a9cdd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1246 microversion: 2.1 time: 0.133622 May 16 15:29:50.561382 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 531/1062] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:50 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1246 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:51.577275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:51.577819 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:51.584486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:51.585161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:51.586246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:51.586685 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:51.756193 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:51.765074 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7db074ed-f909-4ade-aef4-36a4378e5e21 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1312 microversion: 2.1 time: 0.191702 May 16 15:29:51.766257 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 532/1063] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:51 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:52.782978 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:52.784195 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:52.790610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:52.791069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:52.792002 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:52.792479 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:52.925033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:52.932940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5f2f6cfe-3024-428b-af08-e22760ff87ed tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.154116 May 16 15:29:52.933740 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 532/1064] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:52 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:53.951411 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:53.952684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:53.959572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:53.961247 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:53.962336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:53.962993 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:54.130783 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:54.141352 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-4baa304b-4d79-4cc0-8fa4-5b77c7a20d61 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.194288 May 16 15:29:54.142731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 533/1065] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:53 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:54.912642 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-b490d033-30b1-444a-acda-ed2e3f176c88 req-2fd4ceb6-e771-4e00-a3f7-c2537cad6473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48b4d9e-d204-4080-90d6-694383681b7b", "tag": "42875a80-9e6a-4767-a1f5-0b47114b80d8"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:29:54.923335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b490d033-30b1-444a-acda-ed2e3f176c88 req-2fd4ceb6-e771-4e00-a3f7-c2537cad6473 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:54.923789 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b490d033-30b1-444a-acda-ed2e3f176c88 req-2fd4ceb6-e771-4e00-a3f7-c2537cad6473 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:54.938625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-b490d033-30b1-444a-acda-ed2e3f176c88 req-2fd4ceb6-e771-4e00-a3f7-c2537cad6473 service nova] Creating event network-changed:42875a80-9e6a-4767-a1f5-0b47114b80d8 for instance a48b4d9e-d204-4080-90d6-694383681b7b on hv-cinder-79053 May 16 15:29:54.954447 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-b490d033-30b1-444a-acda-ed2e3f176c88 req-2fd4ceb6-e771-4e00-a3f7-c2537cad6473 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039857 May 16 15:29:54.955518 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 533/1066] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:29:55.159384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:55.160150 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:55.167964 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:55.168682 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:55.170405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:55.170405 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:55.468847 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:55.481675 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-afd63b59-571a-4e91-96be-1d2640f56884 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.325123 May 16 15:29:55.483419 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 534/1067] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:55 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:29:56.503522 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:56.504163 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:56.510265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:56.510714 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:56.511489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:56.511921 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:56.643694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:56.652143 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8511c1c0-39a2-405a-b3f7-92b1a78cd0b3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.153262 May 16 15:29:56.652765 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 534/1068] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:56 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:57.669091 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:57.669697 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:57.675977 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:57.676423 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:57.677183 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:57.677611 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:57.837683 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:57.845239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-96753372-b47b-4f51-97d6-f943852d783b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.180461 May 16 15:29:57.845738 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 535/1069] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:57 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:29:58.861500 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:29:58.862959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:29:58.870048 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:58.870538 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:58.871321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:29:58.871762 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:29:59.009962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:29:59.017551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f6ccc89e-2055-414e-a4f3-a4eb58f5efe1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.159866 May 16 15:29:59.018150 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 535/1070] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:29:58 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:00.034580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:00.035219 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:00.041654 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:00.042099 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:00.042993 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:00.043388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:00.172167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:00.179557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c0e310cd-82ce-4096-9050-057a938dc738 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.149011 May 16 15:30:00.180162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 536/1071] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:00 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:01.084105 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e44101fc-e2cf-4ace-b635-ed2478db645f req-73e83308-29d7-4c0f-8577-10ac64f8d7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48b4d9e-d204-4080-90d6-694383681b7b", "name": "network-vif-plugged", "status": "completed", "tag": "42875a80-9e6a-4767-a1f5-0b47114b80d8"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:30:01.093076 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e44101fc-e2cf-4ace-b635-ed2478db645f req-73e83308-29d7-4c0f-8577-10ac64f8d7ad service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:01.093528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e44101fc-e2cf-4ace-b635-ed2478db645f req-73e83308-29d7-4c0f-8577-10ac64f8d7ad service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:01.105115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e44101fc-e2cf-4ace-b635-ed2478db645f req-73e83308-29d7-4c0f-8577-10ac64f8d7ad service nova] Creating event network-vif-plugged:42875a80-9e6a-4767-a1f5-0b47114b80d8 for instance a48b4d9e-d204-4080-90d6-694383681b7b on hv-cinder-79053 May 16 15:30:01.110043 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e44101fc-e2cf-4ace-b635-ed2478db645f req-73e83308-29d7-4c0f-8577-10ac64f8d7ad service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029685 May 16 15:30:01.110648 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 536/1072] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:01.196340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:01.196999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:01.203348 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:01.203792 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:01.207379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:01.207379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:01.340854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:01.348330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-51b02f12-95ca-4ceb-b95f-138e35177b4f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.156120 May 16 15:30:01.348898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 537/1073] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:01 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:02.366472 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:02.366985 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:02.374186 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:02.374644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:02.375420 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:02.375861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:02.507328 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:02.514742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c7e5121d-9d3f-4156-9805-15200352049f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1368 microversion: 2.1 time: 0.152952 May 16 15:30:02.515590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 537/1074] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:02 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:03.532479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:03.533122 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:03.540011 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:03.540488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:03.541253 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:03.541685 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:03.666586 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:03.673898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-24eeed31-4fe9-43d9-bf6e-0e79e7f66982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1557 microversion: 2.1 time: 0.145352 May 16 15:30:03.674488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 538/1075] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:03 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:03.691179 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-c0e49f89-10e5-49c3-99d2-5b28ac68fcbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:03.691641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-c0e49f89-10e5-49c3-99d2-5b28ac68fcbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:03.700337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0e49f89-10e5-49c3-99d2-5b28ac68fcbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:03.700337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0e49f89-10e5-49c3-99d2-5b28ac68fcbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:03.700337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0e49f89-10e5-49c3-99d2-5b28ac68fcbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:03.700337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-c0e49f89-10e5-49c3-99d2-5b28ac68fcbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:03.780127 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-c0e49f89-10e5-49c3-99d2-5b28ac68fcbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092780 May 16 15:30:03.780770 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 538/1076] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:30:03 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:04.820693 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-f7661d9a-0785-4eee-9012-81ae92d58b6e req-e43f7e09-465d-468e-94fe-2fe87b728bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48b4d9e-d204-4080-90d6-694383681b7b", "tag": "42875a80-9e6a-4767-a1f5-0b47114b80d8"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:30:04.829054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-f7661d9a-0785-4eee-9012-81ae92d58b6e req-e43f7e09-465d-468e-94fe-2fe87b728bc9 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:04.829572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-f7661d9a-0785-4eee-9012-81ae92d58b6e req-e43f7e09-465d-468e-94fe-2fe87b728bc9 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:04.840742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-f7661d9a-0785-4eee-9012-81ae92d58b6e req-e43f7e09-465d-468e-94fe-2fe87b728bc9 service nova] Creating event network-changed:42875a80-9e6a-4767-a1f5-0b47114b80d8 for instance a48b4d9e-d204-4080-90d6-694383681b7b on hv-cinder-79053 May 16 15:30:04.846584 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-f7661d9a-0785-4eee-9012-81ae92d58b6e req-e43f7e09-465d-468e-94fe-2fe87b728bc9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029417 May 16 15:30:04.847247 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 539/1077] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:48.512884 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7128dcbf-1a2f-4437-8fb8-705a21dbc70f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:48.513495 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7128dcbf-1a2f-4437-8fb8-705a21dbc70f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:48.519824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7128dcbf-1a2f-4437-8fb8-705a21dbc70f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:48.520283 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7128dcbf-1a2f-4437-8fb8-705a21dbc70f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:48.521049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7128dcbf-1a2f-4437-8fb8-705a21dbc70f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:48.521494 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7128dcbf-1a2f-4437-8fb8-705a21dbc70f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:48.545807 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7128dcbf-1a2f-4437-8fb8-705a21dbc70f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b/ips" status: 200 len: 149 microversion: 2.1 time: 0.037881 May 16 15:30:48.546427 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 539/1078] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:30:48 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:48.557942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa5e3cc3-e677-4095-9a18-eb22d8b426a1"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:30:48.563017 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:48.565242 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:48.565689 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:48.566479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:48.566910 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:48.645580 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Invalid volume: volume fa5e3cc3-e677-4095-9a18-eb22d8b426a1 is already attached to instances: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: POST /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b/os-volume_attachments HTTP/1.1 May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 74 May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:30:48.647349 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {"volumeAttachment": {"volumeId": "fa5e3cc3-e677-4095-9a18-eb22d8b426a1"}} May 16 15:30:48.649539 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Invalid volume: volume fa5e3cc3-e677-4095-9a18-eb22d8b426a1 is already attached to instances: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'server_id': 'a48b4d9e-d204-4080-90d6-694383681b7b', 'body': {'volumeAttachment': {'volumeId': 'fa5e3cc3-e677-4095-9a18-eb22d8b426a1'}}} May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fa5e3cc3-e677-4095-9a18-eb22d8b426a1 is already attached to instances: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:48.650466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fa5e3cc3-e677-4095-9a18-eb22d8b426a1 is already attached to instances: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:48.651932 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fa5e3cc3-e677-4095-9a18-eb22d8b426a1 is already attached to instances: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 400 to user: Invalid volume: volume fa5e3cc3-e677-4095-9a18-eb22d8b426a1 is already attached to instances: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b8290e35-8ad6-4a47-a53d-6532b094f5fd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096494 May 16 15:30:48.654068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 540/1079] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:30:48 2022] POST /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 16 15:30:48.658379 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:48.658881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:48.664835 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:48.665285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:48.666046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:48.666524 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:48.690647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:30:48.995201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-664f946f-d5a6-4f9e-9cd4-2a91dea614cf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 204 len: 0 microversion: 2.1 time: 0.340488 May 16 15:30:48.995815 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 540/1080] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:30:48 2022] DELETE /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 16 15:30:49.003974 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:49.004592 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:49.011960 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:49.012409 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:49.013169 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:49.013609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:49.141686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:49.149414 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8333e3c1-d1ac-4f4c-849c-d0e3777340f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1682 microversion: 2.1 time: 0.149340 May 16 15:30:49.149979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 541/1081] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:48 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:50.167245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:50.167983 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:50.174363 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:50.174835 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:50.175589 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:50.176027 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:50.308700 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:50.316133 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7014c48c-1d06-4b80-96db-72cbf55edf74 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1682 microversion: 2.1 time: 0.153722 May 16 15:30:50.316704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 541/1082] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:50 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:51.332868 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:51.333628 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:51.340229 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:51.340677 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:51.341502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:51.341938 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:51.409163 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:51.417652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f6a1ed14-d57f-40cf-b431-871d37b8811a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 200 len: 1614 microversion: 2.1 time: 0.088066 May 16 15:30:51.418359 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 542/1083] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:51 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:51.455014 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-e3b08ef8-b85c-4519-ac8c-98e5ff7fc2c7 req-22a16d83-4c24-4b56-b088-cd2a20556e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48b4d9e-d204-4080-90d6-694383681b7b", "name": "network-vif-deleted", "tag": "42875a80-9e6a-4767-a1f5-0b47114b80d8"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:30:51.464749 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e3b08ef8-b85c-4519-ac8c-98e5ff7fc2c7 req-22a16d83-4c24-4b56-b088-cd2a20556e47 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:51.468334 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-e3b08ef8-b85c-4519-ac8c-98e5ff7fc2c7 req-22a16d83-4c24-4b56-b088-cd2a20556e47 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:51.476632 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-e3b08ef8-b85c-4519-ac8c-98e5ff7fc2c7 req-22a16d83-4c24-4b56-b088-cd2a20556e47 service nova] Creating event network-vif-deleted:42875a80-9e6a-4767-a1f5-0b47114b80d8 for instance a48b4d9e-d204-4080-90d6-694383681b7b on hv-cinder-79053 May 16 15:30:51.482087 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-e3b08ef8-b85c-4519-ac8c-98e5ff7fc2c7 req-22a16d83-4c24-4b56-b088-cd2a20556e47 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031119 May 16 15:30:51.482720 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 542/1084] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:52.435315 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:52.435955 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:52.442290 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:52.442731 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:52.443502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:52.443939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:52.459057 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b HTTP/1.1 May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:30:52.460661 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:30:52.462066 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'a48b4d9e-d204-4080-90d6-694383681b7b'} May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:30:52.463037 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:30:52.465081 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:30:52.466761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:30:52.466761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3d3cb30a-d80a-4c6d-a9d5-1b6e05f091cd tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 404 len: 111 microversion: 2.1 time: 0.031228 May 16 15:30:52.466761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 543/1085] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:52 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:30:52.473135 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-285bb766-0cd5-449f-81cb-854a6525cf1d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '.version_select at 0x7fddb3cb15e0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:52.584691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-285bb766-0cd5-449f-81cb-854a6525cf1d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112321251" status: 202 len: 0 microversion: 2.1 time: 0.116165 May 16 15:30:52.585473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 543/1086] 10.222.0.76 () {58 vars in 1220 bytes} [Mon May 16 15:30:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112321251 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:30:53.367296 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:53.367798 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:53.374200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:53.374647 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:53.375404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:53.375839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:53.452901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lazy-loading 'services' on Instance uuid 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:30:53.639447 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-93abee02-d833-448f-a5e1-aa0e04dd0cd6 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments/fa5e3cc3-e677-4095-9a18-eb22d8b426a1" status: 202 len: 0 microversion: 2.1 time: 0.275831 May 16 15:30:53.640022 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 544/1087] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:30:53 2022] DELETE /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments/fa5e3cc3-e677-4095-9a18-eb22d8b426a1 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:30:53.648452 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cfaf0be4-5ebf-43b7-b7ba-5dc6a45cea65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:53.649571 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cfaf0be4-5ebf-43b7-b7ba-5dc6a45cea65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:53.657233 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfaf0be4-5ebf-43b7-b7ba-5dc6a45cea65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:53.657735 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfaf0be4-5ebf-43b7-b7ba-5dc6a45cea65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:53.658542 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfaf0be4-5ebf-43b7-b7ba-5dc6a45cea65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:53.658973 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfaf0be4-5ebf-43b7-b7ba-5dc6a45cea65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:53.687861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cfaf0be4-5ebf-43b7-b7ba-5dc6a45cea65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 May 16 15:30:53.688410 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 544/1088] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:30:53 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:54.703640 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a84e136d-8b52-41dc-96a3-4b3cc3f61ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:54.710938 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a84e136d-8b52-41dc-96a3-4b3cc3f61ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:54.712099 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a84e136d-8b52-41dc-96a3-4b3cc3f61ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:54.712593 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a84e136d-8b52-41dc-96a3-4b3cc3f61ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:54.713499 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a84e136d-8b52-41dc-96a3-4b3cc3f61ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:54.714098 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a84e136d-8b52-41dc-96a3-4b3cc3f61ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:54.743377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a84e136d-8b52-41dc-96a3-4b3cc3f61ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047564 May 16 15:30:54.743936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 545/1089] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:30:54 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:55.755283 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-3e17ceac-0250-48e7-b111-9264a3e82f26 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:55.756244 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-3e17ceac-0250-48e7-b111-9264a3e82f26 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:55.763346 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e17ceac-0250-48e7-b111-9264a3e82f26 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:55.763803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e17ceac-0250-48e7-b111-9264a3e82f26 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:55.764574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e17ceac-0250-48e7-b111-9264a3e82f26 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:55.765018 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-3e17ceac-0250-48e7-b111-9264a3e82f26 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:55.792932 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-3e17ceac-0250-48e7-b111-9264a3e82f26 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041816 May 16 15:30:55.793475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 545/1090] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:30:55 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:30:55.850698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:55.851198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:55.857572 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:55.858014 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:55.858802 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:55.859230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:55.884032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:30:56.240594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2f473d35-0c02-4e69-b0ed-adb1a23c4a86 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 204 len: 0 microversion: 2.1 time: 0.393537 May 16 15:30:56.241200 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 546/1091] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:30:55 2022] DELETE /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:30:56.249566 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:56.254147 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:56.256072 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:56.256527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:56.257293 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:56.257737 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:56.388512 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:56.396299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-8d7bf40f-c6b0-4789-84f8-5989896bd493 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1679 microversion: 2.1 time: 0.150985 May 16 15:30:56.396857 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 546/1092] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:56 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:57.414604 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:57.415305 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:57.421737 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:57.422230 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:57.423005 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:57.423439 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:57.550567 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:57.557976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-26a923fe-ab0d-46b2-be3a-7c11b4359596 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1679 microversion: 2.1 time: 0.147641 May 16 15:30:57.559133 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 547/1093] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:57 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:58.287074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:58.287600 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:58.294119 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:58.294598 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:58.295432 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:58.295872 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:58.321105 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:30:58.577250 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:58.578549 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:58.588529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:58.588529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:58.588529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:58.588529 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:58.606480 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5684fd98-c3a9-4689-90eb-6951bf9edcfe tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "DELETE /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 204 len: 0 microversion: 2.1 time: 0.323055 May 16 15:30:58.610169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 547/1094] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:30:58 2022] DELETE /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:30:58.616694 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:58.628793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:58.628793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:58.628793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:58.628793 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:58.629925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:58.668115 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:58.676998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-90b8e9bc-5ee9-4453-9edb-a33122938dc5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1612 microversion: 2.1 time: 0.104108 May 16 15:30:58.677796 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 548/1095] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:58 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:58.839141 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:58.846741 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bdce5e9c-6c6b-450a-98d9-709c405f0ba2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1576 microversion: 2.1 time: 0.234726 May 16 15:30:58.847317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 548/1096] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:58 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:58.952158 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-56e828ef-9f9d-4821-afb8-0c5ca147563a req-587c35ab-7be3-475e-8e16-69c9fdbd8f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6", "name": "network-vif-deleted", "tag": "927a3b06-5b59-49a1-9454-0f5b417ac4b8"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:30:58.960380 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-56e828ef-9f9d-4821-afb8-0c5ca147563a req-587c35ab-7be3-475e-8e16-69c9fdbd8f15 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:58.960825 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-56e828ef-9f9d-4821-afb8-0c5ca147563a req-587c35ab-7be3-475e-8e16-69c9fdbd8f15 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:58.972139 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-56e828ef-9f9d-4821-afb8-0c5ca147563a req-587c35ab-7be3-475e-8e16-69c9fdbd8f15 service nova] Creating event network-vif-deleted:927a3b06-5b59-49a1-9454-0f5b417ac4b8 for instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 on hv-cinder-79053 May 16 15:30:58.977286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-56e828ef-9f9d-4821-afb8-0c5ca147563a req-587c35ab-7be3-475e-8e16-69c9fdbd8f15 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029395 May 16 15:30:58.978170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 549/1097] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:30:59.695321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:59.695938 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:59.706667 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:59.706667 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:59.706667 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:59.706667 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:59.770467 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:30:59.778029 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-df5c9ef0-1035-4126-873d-52f6dc50269b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1612 microversion: 2.1 time: 0.086559 May 16 15:30:59.779264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 549/1098] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:59 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1612 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:30:59.864937 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:30:59.865829 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:30:59.872634 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:59.873165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:30:59.873995 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:30:59.875098 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:00.017935 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:00.025510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fd91aa6b-e517-4b3e-9427-993f0455d503 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1576 microversion: 2.1 time: 0.164677 May 16 15:31:00.026017 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 550/1099] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:30:59 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:00.796629 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:00.800354 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:00.804871 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:00.805352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:00.806193 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:00.807259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:00.840062 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:00.840423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:00.841430 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lazy-loading 'fault' on Instance uuid 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:31:00.913238 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:00.920774 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f4869a57-f9c8-43f0-9aee-85eb7b413f4a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 200 len: 1331 microversion: 2.1 time: 0.128706 May 16 15:31:00.937896 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 550/1100] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:00 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:01.042568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:01.043185 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:01.049767 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:01.050224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:01.051174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:01.051615 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:01.186775 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:01.194205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-fe282477-b1ca-4a8e-ac33-e0070901a618 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1576 microversion: 2.1 time: 0.155536 May 16 15:31:01.194768 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 551/1101] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:01 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:01.420232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-2f9bfe07-62fb-44b3-9365-76f316ea2f69 req-4d400d18-f85c-45be-bfee-eb47a5bfa2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9", "name": "network-vif-deleted", "tag": "b74b55c2-b9e6-45c4-a2d6-501d7668af37"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:01.428138 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f9bfe07-62fb-44b3-9365-76f316ea2f69 req-4d400d18-f85c-45be-bfee-eb47a5bfa2b9 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:01.428525 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-2f9bfe07-62fb-44b3-9365-76f316ea2f69 req-4d400d18-f85c-45be-bfee-eb47a5bfa2b9 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:01.446859 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-2f9bfe07-62fb-44b3-9365-76f316ea2f69 req-4d400d18-f85c-45be-bfee-eb47a5bfa2b9 service nova] Creating event network-vif-deleted:b74b55c2-b9e6-45c4-a2d6-501d7668af37 for instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 on hv-cinder-79053 May 16 15:31:01.452051 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-2f9bfe07-62fb-44b3-9365-76f316ea2f69 req-4d400d18-f85c-45be-bfee-eb47a5bfa2b9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036005 May 16 15:31:01.452856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 551/1102] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:01.945436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:01.946051 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:01.951986 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:01.952478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:01.953421 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:01.954018 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 HTTP/1.1 May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:31:01.971417 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:31:01.973076 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6'} May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:31:01.974030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:31:01.975743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:01.978178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:31:01.978178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-574bd7e3-52d4-43d7-86b4-0e1642ed6e56 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 404 len: 111 microversion: 2.1 time: 0.029911 May 16 15:31:01.978178 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 552/1103] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:01 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:31:01.982767 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-62838427-d147-4ab1-a782-76f4f9eee48a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '.version_select at 0x7fddb3da0b80>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:02.081833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-62838427-d147-4ab1-a782-76f4f9eee48a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896680113" status: 202 len: 0 microversion: 2.1 time: 0.104823 May 16 15:31:02.082506 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 552/1104] 10.222.0.76 () {58 vars in 1217 bytes} [Mon May 16 15:31:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896680113 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:31:02.212119 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:02.212726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:02.220162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:02.220610 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:02.221386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:02.221819 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:02.252845 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:02.253299 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:02.253744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lazy-loading 'fault' on Instance uuid 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:31:02.295864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:02.309547 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-34079947-da90-4140-8ee5-08671e74ca43 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 200 len: 1229 microversion: 2.1 time: 0.100957 May 16 15:31:02.310762 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 553/1105] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:02 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:02.920158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-da70ecbe-2928-46e2-8de3-1aeec0a17b3e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: .version_select at 0x7fddb3cb1820>, body: {"keypair": {"name": "tempest-keypair-385983191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsjQCxp1VxJJ4Col46V+axVcMfkNBvPBpoiESgG+gx/7LqZYhujO63GNmdAnzZU8qND/AwKfCMopmAKcaTX0eXc6ykK1vxZomEyfc1ibNsVtko2rg+p2/UKQsTStCg5Fw=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:02.934234 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-da70ecbe-2928-46e2-8de3-1aeec0a17b3e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:31:02.938679 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-da70ecbe-2928-46e2-8de3-1aeec0a17b3e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:31:03.024627 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-da70ecbe-2928-46e2-8de3-1aeec0a17b3e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108896 May 16 15:31:03.025317 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 553/1106] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:31:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:03.326723 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:03.327335 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:03.333744 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:03.334223 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:03.335030 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:03.335474 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:03.349969 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] HTTP exception thrown: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Request method failure captured: May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 HTTP/1.1 May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm1u_wtAjbFymy6A_wE4Fprc0EtQHG6XwaCSiyO4Ojj-qZWO0fE77nz0-UWGDfmgYftx8SlMc7Ighjjz4PgBUgb9yriA3PaxrrmqQwv3sFyWGm_Kv2WllmwInyg2x7EA_pTzcfDycLSXdEk4FCEgwf_zfjNTo3beSnFm-Jilag8V1Q0 May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:31:03.351532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bc74c97613c4462bb551e50800a5f5e2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-2133671300 May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-2133671300-project May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: e916a70861fc44e69160faf793999f6d May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-2133671300-project May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:31:03.353406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9'} May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:31:03.355209 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:31:03.357336 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:31:03.359358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Returning 404 to user: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:31:03.359358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-dac2dd98-79cd-4379-a314-a5c885247523 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 404 len: 111 microversion: 2.1 time: 0.030187 May 16 15:31:03.359358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 554/1107] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:03 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:31:03.444857 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1811765899", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-88033795", "security_groups": [{"name": "tempest-secgroup-smoke-494742662"}], "block_device_mapping_v2": [{"uuid": "ced1b226-e520-4e20-a4e4-50ed44bc1e29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8109ecd0-18dc-47a3-8ba0-731e552020b2"}]}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:03.560144 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] validate_networks() for [('8109ecd0-18dc-47a3-8ba0-731e552020b2', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:31:03.919840 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:31:03.920269 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:31:03.920780 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:31:03.921226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:31:03.921650 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:31:03.930401 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:03.930856 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:03.931666 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:03.932109 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:03.949683 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for project bc74c97613c4462bb551e50800a5f5e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:31:03.954227 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for user e916a70861fc44e69160faf793999f6d and project bc74c97613c4462bb551e50800a5f5e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:31:04.011836 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:31:04.014742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ced1b226-e520-4e20-a4e4-50ed44bc1e29',volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:31:04.431203 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2d7e3e85-598c-45d3-a9a9-f9b76b38153a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.990240 May 16 15:31:04.431841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 554/1108] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:31:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:31:04.442204 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f9b67f71-db9d-47e7-8256-f62bd3a1e355 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:04.442822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f9b67f71-db9d-47e7-8256-f62bd3a1e355 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:04.521036 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f9b67f71-db9d-47e7-8256-f62bd3a1e355 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:04.533628 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f9b67f71-db9d-47e7-8256-f62bd3a1e355 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1093 microversion: 2.1 time: 0.090105 May 16 15:31:04.533628 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 555/1109] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:04 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:05.276657 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-217482616", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97880a2a-e2c5-4ee9-b5cd-302158bacf22"}], "security_groups": [{"name": "tempest-securitygroup--497798093"}], "key_name": "tempest-keypair-385983191", "user_data": "}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:05.375808 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.network.neutron [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] validate_networks() for [('97880a2a-e2c5-4ee9-b5cd-302158bacf22', None, None, None, None, None)] {{(pid=117616) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:31:05.545146 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:05.545773 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:05.553126 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:05.553577 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:05.554374 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:05.554809 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:05.616441 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:05.624854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-653edb73-9d58-4a19-b072-abcfe386621b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1143 microversion: 2.1 time: 0.083774 May 16 15:31:05.625430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 556/1110] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:05 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:31:05.738806 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:31:05.739318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image limits 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:31:05.739727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:31:05.740132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image pref 0:0:0 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:31:05.740640 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.virt.hardware [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117616) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:31:05.749769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:05.750264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:05.751081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:05.751675 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:05.769118 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:31:05.772985 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:31:05.783769 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Going to run 1 instances... {{(pid=117616) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:31:05.785913 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117616) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:31:05.905053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e2a72213-820f-45bc-851d-e5417d74f52d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.633088 May 16 15:31:05.905703 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 555/1111] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:31:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:31:05.916619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d67cc9af-e030-4f16-833c-dab76ab0ae17 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:05.917350 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d67cc9af-e030-4f16-833c-dab76ab0ae17 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:05.970773 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d67cc9af-e030-4f16-833c-dab76ab0ae17 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:05.977380 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d67cc9af-e030-4f16-833c-dab76ab0ae17 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1240 microversion: 2.1 time: 0.064642 May 16 15:31:05.977944 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 557/1112] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:05 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:06.641959 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:06.642987 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:06.649854 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:06.650359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:06.651294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:06.651575 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:06.733396 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:06.740660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-94faec3e-5c99-4940-9c9c-21ed1a3b9ec0 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1209 microversion: 2.1 time: 0.103521 May 16 15:31:06.741567 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 556/1113] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:06 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:06.994764 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:06.995418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:07.005488 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:07.005952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:07.006786 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:07.008436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:07.071397 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:07.080419 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7aca9c8f-f92e-4c88-884c-a76f32dda0e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1236 microversion: 2.1 time: 0.089887 May 16 15:31:07.080997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 558/1114] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:06 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:07.757188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:07.757818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:07.764912 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:07.766176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:07.766176 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:07.766610 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:08.097468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:08.097992 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:08.098237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:08.105171 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:08.105735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:08.106658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:08.107034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:08.107968 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-2114ef05-d3af-4937-8294-2cfe158a5217 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1276 microversion: 2.1 time: 0.353546 May 16 15:31:08.108660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 557/1115] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:07 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1276 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:08.176766 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:08.184866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-9e471da7-d97c-4fa3-9950-ca6545ee9c3f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1310 microversion: 2.1 time: 0.091338 May 16 15:31:08.185430 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 559/1116] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:08 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:31:08.735280 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-7c4e80fc-1b9f-4b46-b446-aa2b2e985509 req-26ac1452-5087-4f67-90bc-3d8b39d4926a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a5e187-73b3-4577-a8eb-8a5df0f3b611", "tag": "5d2e65be-53b5-48b6-9e23-2fd48edc52bf"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:08.745615 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-7c4e80fc-1b9f-4b46-b446-aa2b2e985509 req-26ac1452-5087-4f67-90bc-3d8b39d4926a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:08.746102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-7c4e80fc-1b9f-4b46-b446-aa2b2e985509 req-26ac1452-5087-4f67-90bc-3d8b39d4926a service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:08.760945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-7c4e80fc-1b9f-4b46-b446-aa2b2e985509 req-26ac1452-5087-4f67-90bc-3d8b39d4926a service nova] Creating event network-changed:5d2e65be-53b5-48b6-9e23-2fd48edc52bf for instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 on hv-cinder-79053 May 16 15:31:08.773805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-7c4e80fc-1b9f-4b46-b446-aa2b2e985509 req-26ac1452-5087-4f67-90bc-3d8b39d4926a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048963 May 16 15:31:08.774585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 558/1117] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:09.125517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:09.126234 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:09.132727 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:09.136142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:09.136142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:09.136142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:09.203858 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:09.204574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:09.223865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:09.224320 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:09.225146 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:09.225587 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:09.302322 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:09.309940 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a1886304-55fe-4455-b656-b95b3264c004 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.188857 May 16 15:31:09.319793 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 560/1118] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:09 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:09.535633 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:09.544143 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bdb66fcf-cece-48e5-8d1e-3ed26c81606e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.345453 May 16 15:31:09.544733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 559/1119] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:09 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:10.327101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:10.332961 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:10.333859 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:10.334342 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:10.335100 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:10.335531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:10.474214 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:10.484040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-510e49d2-19fb-4e5a-b9f6-311e3572eb40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.161196 May 16 15:31:10.484633 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 561/1120] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:10 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:10.564818 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:10.566226 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:10.575646 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:10.576106 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:10.577444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:10.577883 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:10.798988 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-609d0adf-9e45-436d-8b60-057b6a960116 req-5842f2e3-fe49-4e47-b9fc-4449bfa812b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937ee730-2b02-4821-bae0-9628c247c4eb", "tag": "5d152d8f-e7f2-4135-a7bc-4859d7ef9989"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:10.807224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-609d0adf-9e45-436d-8b60-057b6a960116 req-5842f2e3-fe49-4e47-b9fc-4449bfa812b4 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:10.807224 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-609d0adf-9e45-436d-8b60-057b6a960116 req-5842f2e3-fe49-4e47-b9fc-4449bfa812b4 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:10.818315 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-609d0adf-9e45-436d-8b60-057b6a960116 req-5842f2e3-fe49-4e47-b9fc-4449bfa812b4 service nova] Creating event network-changed:5d152d8f-e7f2-4135-a7bc-4859d7ef9989 for instance 937ee730-2b02-4821-bae0-9628c247c4eb on hv-cinder-79053 May 16 15:31:10.823344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-609d0adf-9e45-436d-8b60-057b6a960116 req-5842f2e3-fe49-4e47-b9fc-4449bfa812b4 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028001 May 16 15:31:10.823942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 562/1121] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:31:10.959096 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:10.966366 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b6d21b4c-e6ce-4604-9d5f-27e9ed590750 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.405599 May 16 15:31:10.966933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 560/1122] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:10 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:11.501259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:11.501959 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:11.508497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:11.508943 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:11.509703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:11.510155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:11.691162 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:11.698468 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c3b06e4b-6295-4cd5-959a-bb08e8d7b2ba tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.201408 May 16 15:31:11.699026 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 563/1123] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:11 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:11.983294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:11.994049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:11.994049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:11.994049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:11.994049 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:11.994485 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:12.186940 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:12.194475 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-bc7f14e8-0696-4d1e-8db8-e1f8ae826ffc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.214996 May 16 15:31:12.195419 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 561/1124] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:11 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:12.715018 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:12.715655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:12.721970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:12.722453 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:12.723207 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:12.723636 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:12.854666 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:12.862446 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-56a8a9fc-e6b9-40b9-b4f5-0406e8e0f9ff tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.151385 May 16 15:31:12.863012 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 564/1125] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:12 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:13.056343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:31:13.056590 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Mon May 16 15:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:31:13.212397 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:13.213010 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:13.219881 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:13.220335 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:13.221103 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:13.221543 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:13.347374 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:13.354597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-96156a6f-3cb3-4cee-b3ca-ab6cb5379b08 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.146034 May 16 15:31:13.355203 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 562/1126] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:13 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:13.879546 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:13.880165 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:13.886999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:13.887456 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:13.888225 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:13.888663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:14.017121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:14.024764 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1b5c8135-f4ce-4d57-b4b2-15b3c2c26bc2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.149072 May 16 15:31:14.028983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 565/1127] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:13 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:14.371081 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:14.371682 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:14.378074 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:14.378562 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:14.379340 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:14.379786 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:14.513187 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:14.521748 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-580067b6-1d70-4cda-990d-676dda96bda5 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.154610 May 16 15:31:14.522574 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 563/1128] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:14 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:15.041478 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:15.042110 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:15.048526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:15.048976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:15.049745 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:15.050222 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:15.181709 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:15.189457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e60d3714-38ff-415e-bcd9-6ca0caa5a28d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.152030 May 16 15:31:15.190029 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 566/1129] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:15 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:15.513288 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-08ad1c68-164e-4f7c-9f5e-9f35088fdf11 req-07e78156-623b-469d-be63-0a86a8c8abcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937ee730-2b02-4821-bae0-9628c247c4eb", "name": "network-vif-plugged", "status": "completed", "tag": "5d152d8f-e7f2-4135-a7bc-4859d7ef9989"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:15.522097 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-08ad1c68-164e-4f7c-9f5e-9f35088fdf11 req-07e78156-623b-469d-be63-0a86a8c8abcb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:15.522623 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-08ad1c68-164e-4f7c-9f5e-9f35088fdf11 req-07e78156-623b-469d-be63-0a86a8c8abcb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:15.533245 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-08ad1c68-164e-4f7c-9f5e-9f35088fdf11 req-07e78156-623b-469d-be63-0a86a8c8abcb service nova] Creating event network-vif-plugged:5d152d8f-e7f2-4135-a7bc-4859d7ef9989 for instance 937ee730-2b02-4821-bae0-9628c247c4eb on hv-cinder-79053 May 16 15:31:15.538102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-08ad1c68-164e-4f7c-9f5e-9f35088fdf11 req-07e78156-623b-469d-be63-0a86a8c8abcb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028572 May 16 15:31:15.538901 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 564/1130] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:15.540722 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:15.541532 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:15.547998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:15.548466 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:15.549257 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:15.549682 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:15.679963 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:15.687820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e0f91fc4-3a9f-495b-bff3-c45d124e4333 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.152340 May 16 15:31:15.688382 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 567/1131] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:15 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:31:16.207322 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:16.208028 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:16.214641 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:16.215095 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:16.215879 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:16.216319 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:16.347754 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:16.355257 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-56a0a3d5-8618-4385-b666-2df258a6879b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.152261 May 16 15:31:16.355817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 565/1132] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:16 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:16.704378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:16.704979 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:16.711254 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:16.711696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:16.712453 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:16.712880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:16.840045 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:16.847684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-1295d183-b21f-43cf-b882-9afa436e10e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.147121 May 16 15:31:16.848241 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 568/1133] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:16 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:17.371459 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:17.372082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:17.378868 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:17.379322 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:17.380094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:17.380532 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:17.516155 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:17.524333 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-35e6ed6e-5932-4d29-984c-cda1106868e1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.156674 May 16 15:31:17.524918 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 566/1134] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:17 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:17.867361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:17.867361 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:17.872286 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:17.872820 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:17.874439 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:17.874948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:18.011024 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:18.019274 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c1ac34f0-449c-4de1-b70a-43025a0dae7d tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1365 microversion: 2.1 time: 0.158322 May 16 15:31:18.019886 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 569/1135] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:17 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:18.540691 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:18.541363 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:18.547750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:18.548198 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:18.548967 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:18.549406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:18.677360 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:18.684684 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-db10cceb-0fbe-4a90-b418-052896a5e864 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.147898 May 16 15:31:18.685270 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 567/1136] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:18 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:19.035040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:19.035652 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:19.041983 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:19.042464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:19.043228 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:19.043660 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:19.177756 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:19.185008 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2c686b95-105c-438f-b78a-94d291b3e908 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1554 microversion: 2.1 time: 0.153865 May 16 15:31:19.185577 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 570/1137] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:19 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:19.202258 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-cfc9de9b-349c-4884-b190-de9c39542759 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:19.202762 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-cfc9de9b-349c-4884-b190-de9c39542759 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:19.208620 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfc9de9b-349c-4884-b190-de9c39542759 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:19.209069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfc9de9b-349c-4884-b190-de9c39542759 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:19.209841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfc9de9b-349c-4884-b190-de9c39542759 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:19.210329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-cfc9de9b-349c-4884-b190-de9c39542759 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:19.284232 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-cfc9de9b-349c-4884-b190-de9c39542759 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086565 May 16 15:31:19.284830 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 568/1138] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:31:19 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:19.555321 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-95c744b8-5b37-4aab-93f6-f90a71d945e8 req-bffb4308-4abb-4f1b-9006-986a78a09416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a5e187-73b3-4577-a8eb-8a5df0f3b611", "name": "network-vif-plugged", "status": "completed", "tag": "5d2e65be-53b5-48b6-9e23-2fd48edc52bf"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:19.564269 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-95c744b8-5b37-4aab-93f6-f90a71d945e8 req-bffb4308-4abb-4f1b-9006-986a78a09416 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:19.564799 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-95c744b8-5b37-4aab-93f6-f90a71d945e8 req-bffb4308-4abb-4f1b-9006-986a78a09416 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:19.576326 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-95c744b8-5b37-4aab-93f6-f90a71d945e8 req-bffb4308-4abb-4f1b-9006-986a78a09416 service nova] Creating event network-vif-plugged:5d2e65be-53b5-48b6-9e23-2fd48edc52bf for instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 on hv-cinder-79053 May 16 15:31:19.581577 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-95c744b8-5b37-4aab-93f6-f90a71d945e8 req-bffb4308-4abb-4f1b-9006-986a78a09416 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030324 May 16 15:31:19.585569 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 571/1139] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:19.701359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:19.701962 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:19.709071 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:19.709528 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:19.710407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:19.710852 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:20.091483 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:20.099732 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0517d318-29c2-4973-a3ec-3e93500d0e3f tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.402517 May 16 15:31:20.100384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 569/1140] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:19 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:20.667502 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-4056077a-2532-4ff9-9cd3-744091dc8fbc req-624c0799-fbf4-45db-9cf2-aec11c005da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937ee730-2b02-4821-bae0-9628c247c4eb", "tag": "5d152d8f-e7f2-4135-a7bc-4859d7ef9989"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:20.675809 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4056077a-2532-4ff9-9cd3-744091dc8fbc req-624c0799-fbf4-45db-9cf2-aec11c005da2 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:20.676242 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-4056077a-2532-4ff9-9cd3-744091dc8fbc req-624c0799-fbf4-45db-9cf2-aec11c005da2 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:20.695121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-4056077a-2532-4ff9-9cd3-744091dc8fbc req-624c0799-fbf4-45db-9cf2-aec11c005da2 service nova] Creating event network-changed:5d152d8f-e7f2-4135-a7bc-4859d7ef9989 for instance 937ee730-2b02-4821-bae0-9628c247c4eb on hv-cinder-79053 May 16 15:31:20.700272 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-4056077a-2532-4ff9-9cd3-744091dc8fbc req-624c0799-fbf4-45db-9cf2-aec11c005da2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037245 May 16 15:31:20.701105 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 572/1141] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:21.116549 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:21.117170 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:21.123826 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:21.124913 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:21.125713 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:21.126203 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:21.264892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:21.272489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ada2be6d-2d15-4909-a98a-20bf643e4c74 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1264 microversion: 2.1 time: 0.159914 May 16 15:31:21.273046 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 570/1142] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:21 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:22.346362 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:22.347094 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:22.353402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:22.353850 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:22.354655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:22.355090 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:22.481174 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:22.488928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f71890f8-a00a-497b-9ab1-a9515cfb1cc7 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1451 microversion: 2.1 time: 0.147527 May 16 15:31:22.489489 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 573/1143] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:22 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:22.505300 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:22.505911 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:22.512418 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:22.512878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:22.513685 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:22.514152 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:22.645958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:31:22.653526 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ac2df728-22b2-437f-b766-46b375a6977b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1451 microversion: 2.1 time: 0.152077 May 16 15:31:22.654085 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 571/1144] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:31:22 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:31:24.476188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-ecd04833-d19b-4c98-8b56-1da9843209ba req-2da7eb17-a44b-42f0-8575-89a53f1ed39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a5e187-73b3-4577-a8eb-8a5df0f3b611", "tag": "5d2e65be-53b5-48b6-9e23-2fd48edc52bf"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:24.485245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-ecd04833-d19b-4c98-8b56-1da9843209ba req-2da7eb17-a44b-42f0-8575-89a53f1ed39b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:24.485696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-ecd04833-d19b-4c98-8b56-1da9843209ba req-2da7eb17-a44b-42f0-8575-89a53f1ed39b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:24.498370 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-ecd04833-d19b-4c98-8b56-1da9843209ba req-2da7eb17-a44b-42f0-8575-89a53f1ed39b service nova] Creating event network-changed:5d2e65be-53b5-48b6-9e23-2fd48edc52bf for instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 on hv-cinder-79053 May 16 15:31:24.503358 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-ecd04833-d19b-4c98-8b56-1da9843209ba req-2da7eb17-a44b-42f0-8575-89a53f1ed39b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030911 May 16 15:31:24.503962 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 574/1145] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:31:57.690996 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-926a5eb1-88d8-425f-8927-2d78052b4932 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:31:57.691569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-926a5eb1-88d8-425f-8927-2d78052b4932 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:57.698282 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-926a5eb1-88d8-425f-8927-2d78052b4932 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:57.698734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-926a5eb1-88d8-425f-8927-2d78052b4932 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:57.699514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-926a5eb1-88d8-425f-8927-2d78052b4932 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:57.699952 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-926a5eb1-88d8-425f-8927-2d78052b4932 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:57.722974 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-926a5eb1-88d8-425f-8927-2d78052b4932 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/ips" status: 200 len: 148 microversion: 2.1 time: 0.036576 May 16 15:31:57.723561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 572/1146] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:31:57 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:31:59.351248 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c73ba41c-fbf0-4c37-bada-5f73d23f063e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a36ff42-c75d-4102-be6e-2e85fd915c27"}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:31:59.352385 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c73ba41c-fbf0-4c37-bada-5f73d23f063e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:31:59.358548 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c73ba41c-fbf0-4c37-bada-5f73d23f063e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:59.358997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c73ba41c-fbf0-4c37-bada-5f73d23f063e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:31:59.359762 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c73ba41c-fbf0-4c37-bada-5f73d23f063e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:31:59.360196 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c73ba41c-fbf0-4c37-bada-5f73d23f063e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:00.188371 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c73ba41c-fbf0-4c37-bada-5f73d23f063e tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842515 May 16 15:32:00.188970 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 575/1147] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:31:59 2022] POST /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:32:07.664294 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a36ff42-c75d-4102-be6e-2e85fd915c27"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:32:07.665364 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:07.671799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:07.672251 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:07.673016 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:07.673456 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:07.750909 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Invalid volume: volume 2a36ff42-c75d-4102-be6e-2e85fd915c27 is already attached to instances: 937ee730-2b02-4821-bae0-9628c247c4eb May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: POST /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments HTTP/1.1 May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 74 May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:32:07.752624 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {"volumeAttachment": {"volumeId": "2a36ff42-c75d-4102-be6e-2e85fd915c27"}} May 16 15:32:07.754352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Invalid volume: volume 2a36ff42-c75d-4102-be6e-2e85fd915c27 is already attached to instances: 937ee730-2b02-4821-bae0-9628c247c4eb May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'server_id': '937ee730-2b02-4821-bae0-9628c247c4eb', 'body': {'volumeAttachment': {'volumeId': '2a36ff42-c75d-4102-be6e-2e85fd915c27'}}} May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a36ff42-c75d-4102-be6e-2e85fd915c27 is already attached to instances: 937ee730-2b02-4821-bae0-9628c247c4eb May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:07.755318 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a36ff42-c75d-4102-be6e-2e85fd915c27 is already attached to instances: 937ee730-2b02-4821-bae0-9628c247c4eb May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:32:07.756831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a36ff42-c75d-4102-be6e-2e85fd915c27 is already attached to instances: 937ee730-2b02-4821-bae0-9628c247c4eb May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 400 to user: Invalid volume: volume 2a36ff42-c75d-4102-be6e-2e85fd915c27 is already attached to instances: 937ee730-2b02-4821-bae0-9628c247c4eb {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-e7325fbd-d0d1-45f2-b477-0223e61c50f1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094329 May 16 15:32:07.758329 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 573/1148] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:32:07 2022] POST /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 16 15:32:07.812699 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:07.813203 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:07.819775 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:07.820213 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:07.820976 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:07.821404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:07.899557 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lazy-loading 'services' on Instance uuid 937ee730-2b02-4821-bae0-9628c247c4eb {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:32:08.063866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-13a231dc-b0d9-49df-97ff-63c2bc5bf2cb tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments/2a36ff42-c75d-4102-be6e-2e85fd915c27" status: 202 len: 0 microversion: 2.1 time: 0.255265 May 16 15:32:08.064388 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 576/1149] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:32:07 2022] DELETE /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments/2a36ff42-c75d-4102-be6e-2e85fd915c27 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:32:08.072657 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7dd470b1-f146-4433-88f4-d4ed423ca569 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:08.074184 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7dd470b1-f146-4433-88f4-d4ed423ca569 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:08.080805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7dd470b1-f146-4433-88f4-d4ed423ca569 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:08.081259 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7dd470b1-f146-4433-88f4-d4ed423ca569 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:08.082051 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7dd470b1-f146-4433-88f4-d4ed423ca569 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:08.082527 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7dd470b1-f146-4433-88f4-d4ed423ca569 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:08.112331 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7dd470b1-f146-4433-88f4-d4ed423ca569 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 May 16 15:32:08.112912 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 574/1150] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:32:08 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:32:09.124357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-25fbd56e-e612-4f26-84a3-402b90ac2dbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:09.125410 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-25fbd56e-e612-4f26-84a3-402b90ac2dbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:09.131411 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25fbd56e-e612-4f26-84a3-402b90ac2dbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:09.131855 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25fbd56e-e612-4f26-84a3-402b90ac2dbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:09.132608 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25fbd56e-e612-4f26-84a3-402b90ac2dbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:09.133034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-25fbd56e-e612-4f26-84a3-402b90ac2dbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:09.162346 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-25fbd56e-e612-4f26-84a3-402b90ac2dbf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042242 May 16 15:32:09.166198 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 577/1151] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:32:09 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 16 15:32:09.217833 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:09.218370 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:09.225157 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:09.226403 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:09.226403 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:09.226907 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:09.255053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:32:09.607544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-48a0d82d-8ef5-4e01-a59d-86465e822bdf tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 204 len: 0 microversion: 2.1 time: 0.393345 May 16 15:32:09.608569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 575/1152] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:32:09 2022] DELETE /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:32:09.616131 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:09.620775 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:09.622705 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:09.623161 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:09.623926 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:09.624368 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:09.756701 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:09.763999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f3e5b34a-701e-41fd-bcb9-6e6895f21104 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1678 microversion: 2.1 time: 0.151661 May 16 15:32:09.764573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 578/1153] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:09 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:10.782655 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:10.783363 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:10.790240 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:10.790695 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:10.791474 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:10.791912 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:10.918723 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:10.925287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-5a862203-9b9c-4b54-bdca-7688e26309a4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1678 microversion: 2.1 time: 0.146935 May 16 15:32:10.925855 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 576/1154] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:10 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:11.944852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:11.945510 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:11.951852 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:11.952497 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:11.953266 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:11.953694 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:12.016303 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:12.024103 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-bdd7c35b-da73-4410-a7e6-5fe6242132a7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1611 microversion: 2.1 time: 0.083603 May 16 15:32:12.024772 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 579/1155] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:11 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:12.283991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-20de60f7-5ead-4074-87aa-c38ec9eaab28 req-cadcbe6f-35f3-40db-b077-817a35fe7db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937ee730-2b02-4821-bae0-9628c247c4eb", "name": "network-vif-deleted", "tag": "5d152d8f-e7f2-4135-a7bc-4859d7ef9989"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:32:12.295857 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-20de60f7-5ead-4074-87aa-c38ec9eaab28 req-cadcbe6f-35f3-40db-b077-817a35fe7db8 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:12.296531 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-20de60f7-5ead-4074-87aa-c38ec9eaab28 req-cadcbe6f-35f3-40db-b077-817a35fe7db8 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:12.308382 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-20de60f7-5ead-4074-87aa-c38ec9eaab28 req-cadcbe6f-35f3-40db-b077-817a35fe7db8 service nova] Creating event network-vif-deleted:5d152d8f-e7f2-4135-a7bc-4859d7ef9989 for instance 937ee730-2b02-4821-bae0-9628c247c4eb on hv-cinder-79053 May 16 15:32:12.313511 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-20de60f7-5ead-4074-87aa-c38ec9eaab28 req-cadcbe6f-35f3-40db-b077-817a35fe7db8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094020 May 16 15:32:12.317179 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 577/1156] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:32:13.041657 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:13.042345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:13.048810 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:13.049262 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:13.050033 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:13.050484 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:13.090898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:13.091343 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:13.091795 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lazy-loading 'fault' on Instance uuid 937ee730-2b02-4821-bae0-9628c247c4eb {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:32:13.133205 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:13.140952 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-62fee483-7913-4e30-9ad8-22783bcdaa10 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 200 len: 1330 microversion: 2.1 time: 0.103905 May 16 15:32:13.141524 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 580/1157] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:13 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:14.160053 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:14.161034 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:14.167999 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:14.168445 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:14.169213 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:14.169645 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:14.183361 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb HTTP/1.1 May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:32:14.184965 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:32:14.186644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '937ee730-2b02-4821-bae0-9628c247c4eb'} May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:32:14.187569 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:32:14.188899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:32:14.190359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:32:14.190359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-7e2ece3e-2258-4f6b-b6a4-c24f69d7738c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 404 len: 111 microversion: 2.1 time: 0.031039 May 16 15:32:14.190359 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 578/1158] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:14 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:32:14.195130 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-5261b8b1-71e6-4581-b8c2-7c0797af2cbc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '.version_select at 0x7fddb3f8c700>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:14.248870 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-5261b8b1-71e6-4581-b8c2-7c0797af2cbc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385983191" status: 202 len: 0 microversion: 2.1 time: 0.057452 May 16 15:32:14.249449 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 581/1159] 10.222.0.76 () {58 vars in 1217 bytes} [Mon May 16 15:32:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385983191 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 16 15:32:14.973660 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f0c35559-0f08-413f-a56d-a0cca6706486 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: .version_select at 0x7fddb3b65ee0>, body: {"keypair": {"name": "tempest-keypair-1289678181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YrDWBqFm8MrBCeTNZfxDv1TG02u2Cpg8Q/m3uIEnVraTVgh9axOgIyjxJ7noqsQOktErT14zkIGnaQFYxiUdoAnbXRSsGeTuc/ECINm1Cjv+9wPF4GKximdv+zlktZQ=="}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:32:14.987141 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-f0c35559-0f08-413f-a56d-a0cca6706486 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:32:14.991079 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.quota [None req-f0c35559-0f08-413f-a56d-a0cca6706486 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'key_pairs'} {{(pid=117616) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:32:15.071668 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f0c35559-0f08-413f-a56d-a0cca6706486 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101942 May 16 15:32:15.072253 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 579/1160] 10.222.0.76 () {60 vars in 1158 bytes} [Mon May 16 15:32:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:32:17.069579 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1675469907", "imageRef": "87fb6d44-ca5a-47aa-90a1-31edea9d44cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97880a2a-e2c5-4ee9-b5cd-302158bacf22"}], "security_groups": [{"name": "tempest-securitygroup--1245191286"}], "key_name": "tempest-keypair-1289678181", "user_data": "}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:32:17.169077 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] validate_networks() for [('97880a2a-e2c5-4ee9-b5cd-302158bacf22', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:32:17.784154 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:32:17.784718 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:32:17.785259 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:32:17.785735 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:32:17.786258 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:32:17.795505 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:17.796026 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:17.796898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:17.797415 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:17.813691 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:32:17.817613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Getting quotas for user 066750f0db754834aa2984c2cfd40e9f and project fbaba74aca3d447eb9cc9d56700fa13e. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:32:17.828402 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:32:17.830713 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87fb6d44-ca5a-47aa-90a1-31edea9d44cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:32:17.997902 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-3d1df128-fefd-49a0-bb3a-c0f359f72982 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.933100 May 16 15:32:17.998747 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 582/1161] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:32:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:32:18.009904 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0baf3fc4-279a-4f53-b2d3-836f4069fd7a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:18.010925 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0baf3fc4-279a-4f53-b2d3-836f4069fd7a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:18.096006 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0baf3fc4-279a-4f53-b2d3-836f4069fd7a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:18.104013 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0baf3fc4-279a-4f53-b2d3-836f4069fd7a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1242 microversion: 2.1 time: 0.099130 May 16 15:32:18.104585 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 580/1162] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:18 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:19.121190 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:19.121804 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:19.128453 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:19.128897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:19.129658 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:19.130096 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:19.192122 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:19.199422 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-974a6d50-da8f-4860-b5ef-6ba179a9c969 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1238 microversion: 2.1 time: 0.082448 May 16 15:32:19.199998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 583/1163] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:19 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:20.216189 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:20.216799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:20.223311 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:20.223791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:20.224554 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:20.224989 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:20.314182 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:20.321361 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ce8d459f-a767-4c1b-af04-cd271a56d0e1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1300 microversion: 2.1 time: 0.109308 May 16 15:32:20.321926 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 581/1164] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:20 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:21.341698 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:21.343733 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:21.351344 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:21.351869 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:21.352716 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:21.353568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:21.502360 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:21.509700 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-d2e5cd0a-a9a1-423a-90eb-adb0dd9d1d49 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1368 microversion: 2.1 time: 0.173241 May 16 15:32:21.510916 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 584/1165] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:21 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:21.588799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-08a6c598-972e-4f39-b0af-77a9bab54a55 req-fb847610-4831-4167-81b0-4365ae62ba38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66955270-8a03-464f-9716-79622eab9025", "tag": "dfc4b779-adb3-4a54-9d8c-3bf777260dfd"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:32:21.599036 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-08a6c598-972e-4f39-b0af-77a9bab54a55 req-fb847610-4831-4167-81b0-4365ae62ba38 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:21.599512 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-08a6c598-972e-4f39-b0af-77a9bab54a55 req-fb847610-4831-4167-81b0-4365ae62ba38 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:21.612689 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-08a6c598-972e-4f39-b0af-77a9bab54a55 req-fb847610-4831-4167-81b0-4365ae62ba38 service nova] Creating event network-changed:dfc4b779-adb3-4a54-9d8c-3bf777260dfd for instance 66955270-8a03-464f-9716-79622eab9025 on hv-cinder-79053 May 16 15:32:21.617816 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-08a6c598-972e-4f39-b0af-77a9bab54a55 req-fb847610-4831-4167-81b0-4365ae62ba38 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032626 May 16 15:32:21.618958 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 582/1166] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:32:22.528181 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:22.528796 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:22.535063 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:22.535524 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:22.536256 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:22.536685 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:22.665186 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:22.672873 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cedee37f-e871-403d-9533-061fb4713723 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1368 microversion: 2.1 time: 0.149280 May 16 15:32:22.673426 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 585/1167] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:22 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:23.691172 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:23.691869 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:23.698592 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:23.699039 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:23.699791 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:23.700223 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:23.834292 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:23.842444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0d7d56c7-fac5-4aeb-944b-51e5a1f23ca7 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1368 microversion: 2.1 time: 0.155837 May 16 15:32:23.842947 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 583/1168] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:23 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:24.859501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:24.860181 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:24.866592 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:24.867042 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:24.867810 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:24.868278 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:24.993525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:25.000811 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-12786849-fd45-4922-b211-d7777eddbcc1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1368 microversion: 2.1 time: 0.145262 May 16 15:32:25.001384 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 586/1169] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:24 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:26.017238 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:26.017865 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:26.024590 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:26.029899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:26.029899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:26.029899 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:26.030396 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-556bb037-e07c-45de-907c-8b6328304795 req-e4a49529-6afb-4e55-89f5-b30c85b08356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66955270-8a03-464f-9716-79622eab9025", "name": "network-vif-plugged", "status": "completed", "tag": "dfc4b779-adb3-4a54-9d8c-3bf777260dfd"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:32:26.039058 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-556bb037-e07c-45de-907c-8b6328304795 req-e4a49529-6afb-4e55-89f5-b30c85b08356 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:26.039496 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-556bb037-e07c-45de-907c-8b6328304795 req-e4a49529-6afb-4e55-89f5-b30c85b08356 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:26.050404 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-556bb037-e07c-45de-907c-8b6328304795 req-e4a49529-6afb-4e55-89f5-b30c85b08356 service nova] Creating event network-vif-plugged:dfc4b779-adb3-4a54-9d8c-3bf777260dfd for instance 66955270-8a03-464f-9716-79622eab9025 on hv-cinder-79053 May 16 15:32:26.055663 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-556bb037-e07c-45de-907c-8b6328304795 req-e4a49529-6afb-4e55-89f5-b30c85b08356 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029323 May 16 15:32:26.056253 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 587/1170] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:32:26.160693 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:26.168923 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-25702c40-2df1-448d-996d-b433cfe63816 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1368 microversion: 2.1 time: 0.155678 May 16 15:32:26.169523 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 584/1171] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:26 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:27.185898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:27.186650 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:27.193088 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:27.193531 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:27.194324 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:27.194754 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:27.317736 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:27.325823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-f43315dc-2168-43f1-b9bd-4183c2da907b tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1368 microversion: 2.1 time: 0.144538 May 16 15:32:27.326431 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 588/1172] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:27 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:28.343244 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:28.343832 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:28.350035 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:28.350514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:28.351271 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:28.351707 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:28.476893 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:32:28.484406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-38f55b35-796c-4d1c-9b2e-6f69b164697c tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1556 microversion: 2.1 time: 0.145720 May 16 15:32:28.484980 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 585/1173] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:32:28 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:32:28.500616 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-12d88a3e-643f-4406-9ed9-d46d0387ee53 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:32:28.501124 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-12d88a3e-643f-4406-9ed9-d46d0387ee53 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:32:28.507399 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12d88a3e-643f-4406-9ed9-d46d0387ee53 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:28.507850 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12d88a3e-643f-4406-9ed9-d46d0387ee53 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:28.508618 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12d88a3e-643f-4406-9ed9-d46d0387ee53 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:28.509054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-12d88a3e-643f-4406-9ed9-d46d0387ee53 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:28.589534 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-12d88a3e-643f-4406-9ed9-d46d0387ee53 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092206 May 16 15:32:28.590149 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 589/1174] 10.222.0.76 () {58 vars in 1274 bytes} [Mon May 16 15:32:28 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:32:29.589892 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-90b0eadf-cf04-46ba-be06-99d725011cf2 req-14e2ab55-bb05-47a2-bf35-6e61cb1bb883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66955270-8a03-464f-9716-79622eab9025", "tag": "dfc4b779-adb3-4a54-9d8c-3bf777260dfd"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:32:29.597736 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-90b0eadf-cf04-46ba-be06-99d725011cf2 req-14e2ab55-bb05-47a2-bf35-6e61cb1bb883 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:32:29.598264 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-90b0eadf-cf04-46ba-be06-99d725011cf2 req-14e2ab55-bb05-47a2-bf35-6e61cb1bb883 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:32:29.609888 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-90b0eadf-cf04-46ba-be06-99d725011cf2 req-14e2ab55-bb05-47a2-bf35-6e61cb1bb883 service nova] Creating event network-changed:dfc4b779-adb3-4a54-9d8c-3bf777260dfd for instance 66955270-8a03-464f-9716-79622eab9025 on hv-cinder-79053 May 16 15:32:29.614763 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-90b0eadf-cf04-46ba-be06-99d725011cf2 req-14e2ab55-bb05-47a2-bf35-6e61cb1bb883 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084393 May 16 15:32:29.615355 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 586/1175] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:07.771374 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cfb1ffcc-5bfd-41e3-a8e8-acac4449b960 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:07.771958 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cfb1ffcc-5bfd-41e3-a8e8-acac4449b960 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:07.778084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfb1ffcc-5bfd-41e3-a8e8-acac4449b960 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:07.778573 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfb1ffcc-5bfd-41e3-a8e8-acac4449b960 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:07.779369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfb1ffcc-5bfd-41e3-a8e8-acac4449b960 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:07.779803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cfb1ffcc-5bfd-41e3-a8e8-acac4449b960 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:07.801928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cfb1ffcc-5bfd-41e3-a8e8-acac4449b960 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/ips" status: 200 len: 147 microversion: 2.1 time: 0.035767 May 16 15:33:07.804352 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 590/1176] 10.222.0.76 () {58 vars in 1247 bytes} [Mon May 16 15:33:07 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:09.383799 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b9a6bfe1-f258-4f99-a5e6-36e24a0c52d1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5140e5aa-9e6a-49e1-93de-a1c4b8166276"}} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:09.385029 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b9a6bfe1-f258-4f99-a5e6-36e24a0c52d1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:09.391158 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9a6bfe1-f258-4f99-a5e6-36e24a0c52d1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:09.391688 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9a6bfe1-f258-4f99-a5e6-36e24a0c52d1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:09.393202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9a6bfe1-f258-4f99-a5e6-36e24a0c52d1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:09.393731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b9a6bfe1-f258-4f99-a5e6-36e24a0c52d1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:10.210779 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b9a6bfe1-f258-4f99-a5e6-36e24a0c52d1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "POST /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831751 May 16 15:33:10.211647 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 587/1177] 10.222.0.76 () {60 vars in 1322 bytes} [Mon May 16 15:33:09 2022] POST /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:12.218954 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-971020386", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-88033795", "security_groups": [{"name": "tempest-secgroup-smoke-494742662"}], "block_device_mapping_v2": [{"uuid": "cd16db77-3d0b-490f-9589-e179d75b495c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8109ecd0-18dc-47a3-8ba0-731e552020b2"}]}} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:12.332023 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.network.neutron [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] validate_networks() for [('8109ecd0-18dc-47a3-8ba0-731e552020b2', None, None, None, None, None)] {{(pid=117615) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 16 15:33:12.690235 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Flavor limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 16 15:33:12.690656 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Image limits 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 16 15:33:12.691126 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Flavor pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 16 15:33:12.691525 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Image pref 0:0:0 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 16 15:33:12.691929 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.virt.hardware [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117615) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 16 15:33:12.700239 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:12.700684 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:12.701475 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:12.701901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:12.718109 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for project bc74c97613c4462bb551e50800a5f5e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 16 15:33:12.722526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.quota [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Getting quotas for user e916a70861fc44e69160faf793999f6d and project bc74c97613c4462bb551e50800a5f5e2. Resources: {'cores', 'ram', 'instances'} {{(pid=117615) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 16 15:33:12.776355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Going to run 1 instances... {{(pid=117615) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 16 15:33:12.778486 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd16db77-3d0b-490f-9589-e179d75b495c',volume_size=None,volume_type=None)] {{(pid=117615) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 16 15:33:13.186829 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b89d3bf8-4798-4002-af4e-79a32bb0300b tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.971843 May 16 15:33:13.187487 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 591/1178] 10.222.0.76 () {60 vars in 1146 bytes} [Mon May 16 15:33:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 16 15:33:13.198496 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d5c614e3-5f56-428e-9d57-74bbcd746298 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:13.199235 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d5c614e3-5f56-428e-9d57-74bbcd746298 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:13.250944 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d5c614e3-5f56-428e-9d57-74bbcd746298 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:13.261285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d5c614e3-5f56-428e-9d57-74bbcd746298 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1092 microversion: 2.1 time: 0.067150 May 16 15:33:13.262218 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 588/1179] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:13 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:14.278291 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:14.278889 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:14.285514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:14.286013 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:14.287001 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:14.287438 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:14.346997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:14.354373 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e9439d58-a8fc-4965-8094-0e9ba22bc414 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1142 microversion: 2.1 time: 0.080523 May 16 15:33:14.354928 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 592/1180] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:14 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1142 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:15.370983 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:15.371666 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:15.378804 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:15.379262 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:15.380033 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:15.380473 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:15.441499 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:15.448887 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-09334d62-6c50-4e20-8477-6802da4cf04c tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1208 microversion: 2.1 time: 0.081762 May 16 15:33:15.449482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 589/1181] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:15 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:16.465534 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:16.466173 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:16.473188 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:16.473642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:16.474442 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:16.474879 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:16.625078 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:16.633795 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2d7eba43-f47d-481a-ab93-454e0ec7b341 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1275 microversion: 2.1 time: 0.172110 May 16 15:33:16.634418 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 593/1182] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:16 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:16.821472 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-07944b42-a86f-4c65-932d-34f5eb788b0e req-51b3546b-cfcf-43b1-a1f0-c1f99176eb67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccc0836-bb79-42ef-95fd-4161e4ad2f9a", "tag": "92c54a9a-430b-49f8-a30a-675862e61e19"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:16.829814 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-07944b42-a86f-4c65-932d-34f5eb788b0e req-51b3546b-cfcf-43b1-a1f0-c1f99176eb67 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:16.831751 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-07944b42-a86f-4c65-932d-34f5eb788b0e req-51b3546b-cfcf-43b1-a1f0-c1f99176eb67 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:16.842784 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-07944b42-a86f-4c65-932d-34f5eb788b0e req-51b3546b-cfcf-43b1-a1f0-c1f99176eb67 service nova] Creating event network-changed:92c54a9a-430b-49f8-a30a-675862e61e19 for instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a on hv-cinder-79053 May 16 15:33:16.848492 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-07944b42-a86f-4c65-932d-34f5eb788b0e req-51b3546b-cfcf-43b1-a1f0-c1f99176eb67 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031274 May 16 15:33:16.849412 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 590/1183] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:17.658364 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:17.660483 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:17.671369 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:17.672050 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:17.673170 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:17.673999 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:17.827110 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:17.835032 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e5d79269-6cbe-4f4b-ba7c-6a1381486c8d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1275 microversion: 2.1 time: 0.186157 May 16 15:33:17.835600 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 594/1184] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:17 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:18.853285 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:18.854068 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:18.865356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:18.865356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:18.865356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:18.865356 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:18.920982 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:18.921655 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:18.928492 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:18.928936 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:18.929702 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:18.930156 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:19.001544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:19.013686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-37c6e2ca-f468-4d4a-a506-9971dfdef75d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1275 microversion: 2.1 time: 0.165015 May 16 15:33:19.014686 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 591/1185] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:18 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:19.019275 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.objects.instance [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lazy-loading 'services' on Instance uuid 66955270-8a03-464f-9716-79622eab9025 {{(pid=117615) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:33:19.236416 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-11cd9d5f-e164-448f-a456-d9a29325236a tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments/5140e5aa-9e6a-49e1-93de-a1c4b8166276" status: 202 len: 0 microversion: 2.1 time: 0.319190 May 16 15:33:19.237007 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 595/1186] 10.222.0.76 () {58 vars in 1415 bytes} [Mon May 16 15:33:18 2022] DELETE /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments/5140e5aa-9e6a-49e1-93de-a1c4b8166276 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:33:19.245578 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-82f087bb-6fef-45fe-9ea4-632b163015ec tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:19.246491 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-82f087bb-6fef-45fe-9ea4-632b163015ec tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:19.252803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82f087bb-6fef-45fe-9ea4-632b163015ec tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:19.253262 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82f087bb-6fef-45fe-9ea4-632b163015ec tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:19.254036 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82f087bb-6fef-45fe-9ea4-632b163015ec tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:19.254495 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-82f087bb-6fef-45fe-9ea4-632b163015ec tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:19.285690 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-82f087bb-6fef-45fe-9ea4-632b163015ec tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043627 May 16 15:33:19.286265 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 592/1187] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:33:19 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:20.032072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:20.032839 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:20.039665 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:20.040119 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:20.040960 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:20.041400 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:20.175028 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:20.182408 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-99b31c6f-05d6-4fa1-9c65-228d7c6c4fc1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.155034 May 16 15:33:20.182965 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 596/1188] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:20 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:20.296877 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-808b8fa6-cd28-48cb-97e2-d4f464cacdf4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:20.297770 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-808b8fa6-cd28-48cb-97e2-d4f464cacdf4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:20.304064 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-808b8fa6-cd28-48cb-97e2-d4f464cacdf4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:20.304516 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-808b8fa6-cd28-48cb-97e2-d4f464cacdf4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:20.305287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-808b8fa6-cd28-48cb-97e2-d4f464cacdf4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:20.305727 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-808b8fa6-cd28-48cb-97e2-d4f464cacdf4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:20.334770 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-808b8fa6-cd28-48cb-97e2-d4f464cacdf4 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 May 16 15:33:20.335313 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 593/1189] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:33:20 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:33:21.199271 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:21.199923 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:21.206897 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.207387 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.208154 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.208594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.335438 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:21.342898 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-837f97db-7045-43c1-8c72-1db42a41bf96 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.147487 May 16 15:33:21.343464 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 597/1190] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:21 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:21.346216 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-be13f308-5d94-477f-889f-cd6d0cb5aec1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:21.347644 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-be13f308-5d94-477f-889f-cd6d0cb5aec1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:21.353806 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be13f308-5d94-477f-889f-cd6d0cb5aec1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.354295 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be13f308-5d94-477f-889f-cd6d0cb5aec1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.355057 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be13f308-5d94-477f-889f-cd6d0cb5aec1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.355488 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-be13f308-5d94-477f-889f-cd6d0cb5aec1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.383314 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-be13f308-5d94-477f-889f-cd6d0cb5aec1 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041129 May 16 15:33:21.383850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 594/1191] 10.222.0.76 () {58 vars in 1301 bytes} [Mon May 16 15:33:21 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 16 15:33:21.443724 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:21.444250 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:21.450179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.450568 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.451325 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.451755 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.476491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:33:21.772420 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c3161396-0bcf-4ecc-afad-0453c6f118ee tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 204 len: 0 microversion: 2.1 time: 0.332244 May 16 15:33:21.773234 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 598/1192] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:33:21 2022] DELETE /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:33:21.781573 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:21.782214 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:21.788169 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.788617 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.789372 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:21.789800 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:21.915406 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:21.922688 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-6d777219-c50d-4403-a444-8077532e55bc tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1680 microversion: 2.1 time: 0.145036 May 16 15:33:21.923251 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 595/1193] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:21 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:22.360252 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:22.360948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:22.367436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:22.367882 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:22.368642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:22.369072 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:22.497317 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:22.505141 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c90e94ca-bc8c-4786-9cc1-1b12c95f9900 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.149146 May 16 15:33:22.505697 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 599/1194] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:22 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:22.939337 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:22.939862 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:22.946222 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:22.946672 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:22.947432 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:22.947861 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:23.076204 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:23.084094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b7adedb1-6f60-4f3a-bce9-b45e4bc4dd65 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1680 microversion: 2.1 time: 0.148678 May 16 15:33:23.084663 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 596/1195] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:22 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:23.521333 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:23.522048 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:23.528671 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:23.529120 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:23.529880 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:23.530340 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:23.659896 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:23.667479 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-801477e5-a962-49a5-967e-6b334949ff9e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.150573 May 16 15:33:23.668054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 600/1196] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:23 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:24.105837 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:24.106559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:24.113847 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:24.114482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:24.115274 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:24.115716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:24.334850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:24.342537 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-662064e2-554f-465b-a21f-2601c591c609 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1680 microversion: 2.1 time: 0.244377 May 16 15:33:24.343115 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 597/1197] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:24 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:24.684881 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:24.685583 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:24.691771 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:24.692210 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:24.692972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:24.693400 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:24.807873 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-16982868-7bcf-4d63-91e6-baf3804a924d req-54f9446d-aa10-4cd2-abf1-c95827329fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66955270-8a03-464f-9716-79622eab9025", "name": "network-vif-deleted", "tag": "dfc4b779-adb3-4a54-9d8c-3bf777260dfd"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:24.816434 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-16982868-7bcf-4d63-91e6-baf3804a924d req-54f9446d-aa10-4cd2-abf1-c95827329fcd service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:24.816897 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-16982868-7bcf-4d63-91e6-baf3804a924d req-54f9446d-aa10-4cd2-abf1-c95827329fcd service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:24.828597 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-16982868-7bcf-4d63-91e6-baf3804a924d req-54f9446d-aa10-4cd2-abf1-c95827329fcd service nova] Creating event network-vif-deleted:dfc4b779-adb3-4a54-9d8c-3bf777260dfd for instance 66955270-8a03-464f-9716-79622eab9025 on hv-cinder-79053 May 16 15:33:24.834522 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:24.834683 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-16982868-7bcf-4d63-91e6-baf3804a924d req-54f9446d-aa10-4cd2-abf1-c95827329fcd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030069 May 16 15:33:24.835100 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 598/1198] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:33:24.846765 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-e600b9e9-d9e1-489a-8059-d9165bf0407a tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.165646 May 16 15:33:24.856246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 601/1199] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:24 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:25.363664 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:25.364933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:25.371482 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:25.371945 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:25.372739 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:25.373188 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:25.404279 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:25.404729 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:25.405177 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lazy-loading 'fault' on Instance uuid 66955270-8a03-464f-9716-79622eab9025 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:33:25.445805 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066750f0db754834aa2984c2cfd40e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbaba74aca3d447eb9cc9d56700fa13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:25.453091 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-fcee9555-9225-4789-9295-13f303437e6f tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 200 len: 1332 microversion: 2.1 time: 0.096177 May 16 15:33:25.453668 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 599/1200] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:25 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:25.864524 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:25.865131 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:25.874743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:25.874743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:25.874743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:25.874743 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:26.006564 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:26.013998 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-48c2c007-79a4-4fbd-b435-39bba62ca448 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.154044 May 16 15:33:26.014676 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 602/1201] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:25 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:26.469553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:26.470100 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:26.476478 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:26.476936 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:26.477709 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:26.478186 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:26.494824 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 HTTP/1.1 May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:33:26.496489 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:26.498094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '66955270-8a03-464f-9716-79622eab9025'} May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:26.499038 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:26.500734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:26.502168 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:26.502168 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b458fd94-68d9-459a-bbb5-d84e287238d9 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 404 len: 111 microversion: 2.1 time: 0.032449 May 16 15:33:26.502168 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 600/1202] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:26 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:26.509582 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8d144656-8f05-4ad1-b5ed-ea1d4dafbf90 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '.version_select at 0x7fddb3db5820>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:26.586947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8d144656-8f05-4ad1-b5ed-ea1d4dafbf90 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289678181" status: 202 len: 0 microversion: 2.1 time: 0.081412 May 16 15:33:26.588538 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 603/1203] 10.222.0.76 () {58 vars in 1220 bytes} [Mon May 16 15:33:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289678181 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:33:27.031671 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:27.032303 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:27.039215 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:27.039598 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:27.040384 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:27.040843 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:27.214284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:27.221539 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d754d691-4f82-4d3a-82f3-32f61921f2cc tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.193729 May 16 15:33:27.222628 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 601/1204] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:27 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:28.240257 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:28.240884 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:28.246726 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:28.247176 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:28.247960 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:28.248381 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:28.371204 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-23e25d77-0812-4e03-a245-afaee441d402 req-3b4b73c4-8e84-45a1-93e0-376a4f29b6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccc0836-bb79-42ef-95fd-4161e4ad2f9a", "name": "network-vif-plugged", "status": "completed", "tag": "92c54a9a-430b-49f8-a30a-675862e61e19"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:28.380025 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-23e25d77-0812-4e03-a245-afaee441d402 req-3b4b73c4-8e84-45a1-93e0-376a4f29b6fb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:28.380479 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-23e25d77-0812-4e03-a245-afaee441d402 req-3b4b73c4-8e84-45a1-93e0-376a4f29b6fb service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:28.382357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:28.389757 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-8b835fd7-8d1b-437d-87b8-a2e2e24bcce2 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.154566 May 16 15:33:28.390810 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 604/1205] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:28 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:33:28.392753 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-23e25d77-0812-4e03-a245-afaee441d402 req-3b4b73c4-8e84-45a1-93e0-376a4f29b6fb service nova] Creating event network-vif-plugged:92c54a9a-430b-49f8-a30a-675862e61e19 for instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a on hv-cinder-79053 May 16 15:33:28.399167 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-23e25d77-0812-4e03-a245-afaee441d402 req-3b4b73c4-8e84-45a1-93e0-376a4f29b6fb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105625 May 16 15:33:28.399844 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 602/1206] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:33:28.645619 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:28.646260 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:28.652365 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:28.652817 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:28.653594 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:28.654034 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:28.667688 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: DELETE /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 HTTP/1.1 May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:33:28.669357 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.670997 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '66955270-8a03-464f-9716-79622eab9025'} May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:28.671822 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.673121 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:28.675642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:28.675642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-39028eae-33c4-4886-b95c-860d07d37746 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 404 len: 111 microversion: 2.1 time: 0.029057 May 16 15:33:28.675642 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 605/1207] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:33:28 2022] DELETE /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:28.680403 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:28.681102 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 66955270-8a03-464f-9716-79622eab9025] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:28.687069 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:28.687515 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:28.688284 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:28.688719 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:28.701801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 HTTP/1.1 May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:33:28.703455 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.705239 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '66955270-8a03-464f-9716-79622eab9025'} May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:28.706444 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. May 16 15:33:28.707919 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:28.709276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 66955270-8a03-464f-9716-79622eab9025 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:28.709276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-93bcff17-9472-4651-8052-baba3ae50e04 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025" status: 404 len: 111 microversion: 2.1 time: 0.028580 May 16 15:33:28.709276 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 603/1208] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:28 2022] GET /compute/v2.1/servers/66955270-8a03-464f-9716-79622eab9025 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:29.406112 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:29.406761 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:29.413054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:29.416142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:29.416142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:29.416142 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:29.549596 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:29.556942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-2cd661b4-f8ae-4f4f-9fc7-677420e492dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1263 microversion: 2.1 time: 0.154791 May 16 15:33:29.557501 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 606/1209] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:29 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:29.968257 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:29.968759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:29.975706 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:29.976164 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:29.976933 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:29.977377 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:29.990842 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb HTTP/1.1 May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:33:29.992398 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:29.994017 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '937ee730-2b02-4821-bae0-9628c247c4eb'} May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:29.997771 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:29.999551 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:30.001041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:30.001041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-d0480245-4811-43f9-9703-6abf0cb45ec3 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 404 len: 111 microversion: 2.1 time: 0.029565 May 16 15:33:30.001041 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 604/1210] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:33:29 2022] DELETE /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:33:30.004729 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:30.005377 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 937ee730-2b02-4821-bae0-9628c247c4eb] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:30.011490 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.011939 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.012710 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.013145 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.027118 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb HTTP/1.1 May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:33:30.028668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:30.030316 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '937ee730-2b02-4821-bae0-9628c247c4eb'} May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:30.031251 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. May 16 15:33:30.032742 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.034155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 937ee730-2b02-4821-bae0-9628c247c4eb could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:30.034155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-b7d71a5d-2d6b-48cb-bb60-061f6024c092 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb" status: 404 len: 111 microversion: 2.1 time: 0.029794 May 16 15:33:30.034155 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 607/1211] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:29 2022] GET /compute/v2.1/servers/937ee730-2b02-4821-bae0-9628c247c4eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:30.038553 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:30.039056 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:30.045368 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.045867 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.046689 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.047112 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.061409 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b HTTP/1.1 May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:33:30.063009 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.068310 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': 'a48b4d9e-d204-4080-90d6-694383681b7b'} May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:30.069202 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.070716 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:30.072196 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:30.072196 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-676150cc-a2c8-49d5-8320-ebde11a1a8e2 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 404 len: 111 microversion: 2.1 time: 0.029751 May 16 15:33:30.072196 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 605/1212] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:33:30 2022] DELETE /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:30.077375 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:30.077985 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: a48b4d9e-d204-4080-90d6-694383681b7b] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:30.085246 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.085701 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.086473 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.086904 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.099966 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b HTTP/1.1 May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:33:30.101462 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.103084 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'a48b4d9e-d204-4080-90d6-694383681b7b'} May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:30.104138 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. May 16 15:33:30.105653 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:30.107355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance a48b4d9e-d204-4080-90d6-694383681b7b could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:30.107355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-649f59b0-1a19-44e7-b2f5-d5164d3c4806 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b" status: 404 len: 111 microversion: 2.1 time: 0.029330 May 16 15:33:30.107355 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 608/1213] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:30 2022] GET /compute/v2.1/servers/a48b4d9e-d204-4080-90d6-694383681b7b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:30.573201 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:30.573750 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:30.579841 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.580297 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.581072 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.581513 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.715723 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:30.723968 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-0cf43b54-8b97-4149-8001-ea056029a8fb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1450 microversion: 2.1 time: 0.154913 May 16 15:33:30.724530 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 606/1214] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:30 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:30.739703 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:30.740320 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:30.746668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.747115 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.747883 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:30.748321 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:30.874526 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:33:30.882406 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-847bd08a-9253-4aed-97bb-d0f5c61886ac tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1450 microversion: 2.1 time: 0.146511 May 16 15:33:30.882972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 609/1215] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:30 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:33:31.374258 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:31.374834 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:31.382012 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:31.382512 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:31.383323 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:31.383760 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:31.397941 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 HTTP/1.1 May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:33:31.399733 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.401369 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6'} May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:31.402275 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.403838 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:33:31.405327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:31.405327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-de1fa791-d11b-45dc-ac64-eabff2880ab8 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "DELETE /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 404 len: 111 microversion: 2.1 time: 0.030918 May 16 15:33:31.405327 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 607/1216] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:33:31 2022] DELETE /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:31.411236 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:33:31.414238 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] [instance: 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:33:31.417921 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:31.418407 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:31.419177 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:31.419616 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:31.433265 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] HTTP exception thrown: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Request method failure captured: May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 HTTP/1.1 May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm2PPJXRLiexiJkodlC-1_ofMY4Ul8-QN3rvytEnKMeMsSf_czMRyQAAqkGMIrgQsV4Iui3wzCbIxvE7MHA7vJHChzTO7amzGUGNKvdyXY-m1tqaAC6fF85bbkIUebkziXmGEQbSWfkrRwIj2PIzLNpHqs9vGHvhEDFfQMFhw0zECCQ May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:33:31.434834 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbaba74aca3d447eb9cc9d56700fa13e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbaba74aca3d447eb9cc9d56700fa13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: fbaba74aca3d447eb9cc9d56700fa13e May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-748872116 May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: 066750f0db754834aa2984c2cfd40e9f May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-AttachVolumeNegativeTest-748872116-project May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.436245 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6'} May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:33:31.437211 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. May 16 15:33:31.438782 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:33:31.440500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] Returning 404 to user: Instance 6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:33:31.440500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-c40783f3-35f6-4ade-93ce-f23de3b30417 tempest-AttachVolumeNegativeTest-748872116 tempest-AttachVolumeNegativeTest-748872116-project] 10.222.0.76 "GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6" status: 404 len: 111 microversion: 2.1 time: 0.028883 May 16 15:33:31.440500 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 610/1217] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:33:31 2022] GET /compute/v2.1/servers/6f244c1e-3bfd-4ac2-9f1f-d1502e9f9df6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:33:33.165121 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-b687b9c4-5fa6-4678-87c6-6e0fd8949859 req-504b88d2-b3ce-40c1-97e2-3a8bebdc6b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccc0836-bb79-42ef-95fd-4161e4ad2f9a", "tag": "92c54a9a-430b-49f8-a30a-675862e61e19"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:33:33.175866 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b687b9c4-5fa6-4678-87c6-6e0fd8949859 req-504b88d2-b3ce-40c1-97e2-3a8bebdc6b6f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:33:33.179625 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-b687b9c4-5fa6-4678-87c6-6e0fd8949859 req-504b88d2-b3ce-40c1-97e2-3a8bebdc6b6f service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:33:33.195785 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-b687b9c4-5fa6-4678-87c6-6e0fd8949859 req-504b88d2-b3ce-40c1-97e2-3a8bebdc6b6f service nova] Creating event network-changed:92c54a9a-430b-49f8-a30a-675862e61e19 for instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a on hv-cinder-79053 May 16 15:33:33.200851 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-b687b9c4-5fa6-4678-87c6-6e0fd8949859 req-504b88d2-b3ce-40c1-97e2-3a8bebdc6b6f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039471 May 16 15:33:33.201443 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 608/1218] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:34:46.526817 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:34:46.528044 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Mon May 16 15:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:35:01.994491 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:01.995609 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:01.998654 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-7a11737f-06e3-45a3-8a4b-792d7e95f841 req-88e184a0-a33d-4ca5-aa88-c0d2cc3e5245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccc0836-bb79-42ef-95fd-4161e4ad2f9a", "tag": "92c54a9a-430b-49f8-a30a-675862e61e19"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:35:02.003040 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:02.003730 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:02.004517 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:02.004956 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:02.007135 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-7a11737f-06e3-45a3-8a4b-792d7e95f841 req-88e184a0-a33d-4ca5-aa88-c0d2cc3e5245 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:02.007586 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-7a11737f-06e3-45a3-8a4b-792d7e95f841 req-88e184a0-a33d-4ca5-aa88-c0d2cc3e5245 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:02.018821 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-7a11737f-06e3-45a3-8a4b-792d7e95f841 req-88e184a0-a33d-4ca5-aa88-c0d2cc3e5245 service nova] Creating event network-changed:92c54a9a-430b-49f8-a30a-675862e61e19 for instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a on hv-cinder-79053 May 16 15:35:02.024063 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-7a11737f-06e3-45a3-8a4b-792d7e95f841 req-88e184a0-a33d-4ca5-aa88-c0d2cc3e5245 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031839 May 16 15:35:02.025209 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 609/1219] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 16 15:35:02.034864 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Going to try to terminate instance {{(pid=117615) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:35:02.331899 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-43a8029e-8d63-4eb3-b274-b370598b3c36 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "DELETE /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 204 len: 0 microversion: 2.1 time: 0.342119 May 16 15:35:02.335613 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 611/1220] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:35:01 2022] DELETE /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:35:02.341867 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:02.342514 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:02.348704 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:02.349168 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:02.349950 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:02.350416 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:02.523126 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:02.531734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-a1d9e0d6-ebf5-4226-ba7d-a2b34eade13d tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1575 microversion: 2.1 time: 0.194673 May 16 15:35:02.532312 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 610/1221] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:02 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:03.552243 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:03.552972 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:03.558948 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:03.559401 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:03.560167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:03.560601 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:03.696179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:03.704426 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-a3f798be-03e5-4239-a773-af534807fc4e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1575 microversion: 2.1 time: 0.156545 May 16 15:35:03.707990 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 612/1222] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:03 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:04.684007 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-058932e7-dc7e-481a-9fb2-410abce53b98 req-c5f080b2-aaca-4e4b-9bdd-3fdb5b3d0c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccc0836-bb79-42ef-95fd-4161e4ad2f9a", "name": "network-vif-deleted", "tag": "92c54a9a-430b-49f8-a30a-675862e61e19"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:35:04.692903 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-058932e7-dc7e-481a-9fb2-410abce53b98 req-c5f080b2-aaca-4e4b-9bdd-3fdb5b3d0c0b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:04.693352 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-058932e7-dc7e-481a-9fb2-410abce53b98 req-c5f080b2-aaca-4e4b-9bdd-3fdb5b3d0c0b service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:04.704094 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-058932e7-dc7e-481a-9fb2-410abce53b98 req-c5f080b2-aaca-4e4b-9bdd-3fdb5b3d0c0b service nova] Creating event network-vif-deleted:92c54a9a-430b-49f8-a30a-675862e61e19 for instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a on hv-cinder-79053 May 16 15:35:04.708823 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-058932e7-dc7e-481a-9fb2-410abce53b98 req-c5f080b2-aaca-4e4b-9bdd-3fdb5b3d0c0b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028495 May 16 15:35:04.709397 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 611/1223] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:35:04.720664 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:04.739068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:04.739068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:04.739068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:04.739068 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:04.739571 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:04.794947 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:04.802386 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-cba0728c-8c7a-4de1-95ef-602a3c2d12bd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1389 microversion: 2.1 time: 0.085540 May 16 15:35:04.807854 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 613/1224] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:04 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:05.820991 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:05.821602 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:05.827782 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:05.828238 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:05.829005 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:05.829454 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:05.859850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:05.860299 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:05.860742 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lazy-loading 'fault' on Instance uuid 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:35:05.899664 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:05.907731 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-682f0abf-3c30-416a-8bf6-c7b8c579d154 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 200 len: 1228 microversion: 2.1 time: 0.091559 May 16 15:35:05.908293 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 612/1225] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:05 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:06.925220 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:06.925824 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:06.936553 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:06.937345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:06.938748 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:06.939530 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:06.953421 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] HTTP exception thrown: Instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a could not be found. May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Request method failure captured: May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a HTTP/1.1 May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm1u_wtAjbFymy6A_wE4Fprc0EtQHG6XwaCSiyO4Ojj-qZWO0fE77nz0-UWGDfmgYftx8SlMc7Ighjjz4PgBUgb9yriA3PaxrrmqQwv3sFyWGm_Kv2WllmwInyg2x7EA_pTzcfDycLSXdEk4FCEgwf_zfjNTo3beSnFm-Jilag8V1Q0 May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:35:06.955083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bc74c97613c4462bb551e50800a5f5e2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: e916a70861fc44e69160faf793999f6d May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a could not be found. May 16 15:35:06.956670 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '4ccc0836-bb79-42ef-95fd-4161e4ad2f9a'} May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a could not be found. May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:35:06.957602 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a could not be found. May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a could not be found. May 16 15:35:06.959345 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:06.960920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Returning 404 to user: Instance 4ccc0836-bb79-42ef-95fd-4161e4ad2f9a could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:35:06.960920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-ec817cb0-5f04-4d16-93d9-9239242c6939 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a" status: 404 len: 111 microversion: 2.1 time: 0.035349 May 16 15:35:06.960920 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 614/1226] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:06 2022] GET /compute/v2.1/servers/4ccc0836-bb79-42ef-95fd-4161e4ad2f9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:35:10.499544 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:10.500086 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:10.501329 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [req-42857e49-1d66-441b-bff3-9d3d00a9a4f8 req-bcdab1d0-25ac-4ec5-bbfc-ebd5c5699e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a5e187-73b3-4577-a8eb-8a5df0f3b611", "tag": "5d2e65be-53b5-48b6-9e23-2fd48edc52bf"}]} {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:35:10.506460 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:10.506916 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:10.508111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:10.508111 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:10.510054 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-42857e49-1d66-441b-bff3-9d3d00a9a4f8 req-bcdab1d0-25ac-4ec5-bbfc-ebd5c5699e40 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:10.510618 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [req-42857e49-1d66-441b-bff3-9d3d00a9a4f8 req-bcdab1d0-25ac-4ec5-bbfc-ebd5c5699e40 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:10.522233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.compute.server_external_events [req-42857e49-1d66-441b-bff3-9d3d00a9a4f8 req-bcdab1d0-25ac-4ec5-bbfc-ebd5c5699e40 service nova] Creating event network-changed:5d2e65be-53b5-48b6-9e23-2fd48edc52bf for instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 on hv-cinder-79053 May 16 15:35:10.528457 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [req-42857e49-1d66-441b-bff3-9d3d00a9a4f8 req-bcdab1d0-25ac-4ec5-bbfc-ebd5c5699e40 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031314 May 16 15:35:10.530514 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 615/1227] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:35:10.533864 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Going to try to terminate instance {{(pid=117616) delete /opt/stack/nova/nova/compute/api.py:2664}} May 16 15:35:10.791935 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-b13756a6-ff15-43db-aa5f-5b1976bc96dd tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 204 len: 0 microversion: 2.1 time: 0.296762 May 16 15:35:10.792803 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 613/1228] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:35:10 2022] DELETE /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 16 15:35:10.802815 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:10.803696 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:10.810330 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:10.811803 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:10.812341 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:10.812778 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:10.943632 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:10.951494 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-269ba604-7715-4b77-9e11-a0d4769892cb tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1576 microversion: 2.1 time: 0.153559 May 16 15:35:10.953119 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 616/1229] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:10 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 16 15:35:11.972850 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:11.973557 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:11.979561 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:11.980023 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:11.980878 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:11.981321 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:12.183289 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:12.190831 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-ea225d09-0745-4b45-9576-1022bc7143ca tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1576 microversion: 2.1 time: 0.222339 May 16 15:35:12.191407 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 614/1230] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:11 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:13.214083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:13.214083 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:13.216686 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:13.216878 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:13.217668 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:13.218104 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:13.250905 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [req-49322279-a3dc-4a92-bb0b-2a81937944b8 req-ea8ea071-7b3f-4323-9ba0-f49f08e88258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a5e187-73b3-4577-a8eb-8a5df0f3b611", "name": "network-vif-deleted", "tag": "5d2e65be-53b5-48b6-9e23-2fd48edc52bf"}]} {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 16 15:35:13.260254 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-49322279-a3dc-4a92-bb0b-2a81937944b8 req-ea8ea071-7b3f-4323-9ba0-f49f08e88258 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:13.260703 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [req-49322279-a3dc-4a92-bb0b-2a81937944b8 req-ea8ea071-7b3f-4323-9ba0-f49f08e88258 service nova] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:13.271767 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.compute.server_external_events [req-49322279-a3dc-4a92-bb0b-2a81937944b8 req-ea8ea071-7b3f-4323-9ba0-f49f08e88258 service nova] Creating event network-vif-deleted:5d2e65be-53b5-48b6-9e23-2fd48edc52bf for instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 on hv-cinder-79053 May 16 15:35:13.276883 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [req-49322279-a3dc-4a92-bb0b-2a81937944b8 req-ea8ea071-7b3f-4323-9ba0-f49f08e88258 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030212 May 16 15:35:13.277466 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 615/1231] 10.222.0.76 () {64 vars in 1317 bytes} [Mon May 16 15:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 16 15:35:13.282762 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.policy [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117615) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:13.290426 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-41867bcb-e7f9-48e6-9c75-62d98e2c8c20 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1390 microversion: 2.1 time: 0.086313 May 16 15:35:13.291167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 617/1232] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:13 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:14.309558 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:14.310462 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:14.316559 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:14.317016 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:14.317796 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:14.318287 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:14.348788 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:14.349246 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:14.349697 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.objects.instance [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lazy-loading 'fault' on Instance uuid e8a5e187-73b3-4577-a8eb-8a5df0f3b611 {{(pid=117616) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 16 15:35:14.390028 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.policy [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e916a70861fc44e69160faf793999f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc74c97613c4462bb551e50800a5f5e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117616) authorize /opt/stack/nova/nova/policy.py:199}} May 16 15:35:14.397530 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-f0cf6144-f40f-452c-a989-7adb0725c3d1 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 200 len: 1229 microversion: 2.1 time: 0.092864 May 16 15:35:14.398082 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 616/1233] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:14 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 16 15:35:15.415233 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:15.415851 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: e8a5e187-73b3-4577-a8eb-8a5df0f3b611] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:15.422217 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:15.422666 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:15.423429 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:15.423866 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:15.438823 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] HTTP exception thrown: Instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 could not be found. May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Request method failure captured: May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 HTTP/1.1 May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm1u_wtAjbFymy6A_wE4Fprc0EtQHG6XwaCSiyO4Ojj-qZWO0fE77nz0-UWGDfmgYftx8SlMc7Ighjjz4PgBUgb9yriA3PaxrrmqQwv3sFyWGm_Kv2WllmwInyg2x7EA_pTzcfDycLSXdEk4FCEgwf_zfjNTo3beSnFm-Jilag8V1Q0 May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:35:15.440436 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bc74c97613c4462bb551e50800a5f5e2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: e916a70861fc44e69160faf793999f6d May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 could not be found. May 16 15:35:15.442166 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': 'e8a5e187-73b3-4577-a8eb-8a5df0f3b611'} May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 could not be found. May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:35:15.443179 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 could not be found. May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 could not be found. May 16 15:35:15.444901 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.446398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Returning 404 to user: Instance e8a5e187-73b3-4577-a8eb-8a5df0f3b611 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:35:15.446398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-7cafd9fa-9fe8-4ce4-a28a-98add51cc06e tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611" status: 404 len: 111 microversion: 2.1 time: 0.030425 May 16 15:35:15.446398 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 618/1234] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:15 2022] GET /compute/v2.1/servers/e8a5e187-73b3-4577-a8eb-8a5df0f3b611 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 16 15:35:15.926507 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:15.934190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.compute.api [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117616) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:15.934190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:15.934190 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:15.934801 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:15.935241 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG oslo_concurrency.lockutils [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117616) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:15.948400 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.wsgi [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] HTTP exception thrown: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Request method failure captured: May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: request: DELETE /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 HTTP/1.1 May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept: application/json May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Accept-Encoding: identity May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Connection: close May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Length: 0 May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Content-Type: application/json May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Host: 10.222.0.76 May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Openstack-System-Scope: None May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: User-Agent: python-urllib3/1.26.9 May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Auth-Token: gAAAAABigm1u_wtAjbFymy6A_wE4Fprc0EtQHG6XwaCSiyO4Ojj-qZWO0fE77nz0-UWGDfmgYftx8SlMc7Ighjjz4PgBUgb9yriA3PaxrrmqQwv3sFyWGm_Kv2WllmwInyg2x7EA_pTzcfDycLSXdEk4FCEgwf_zfjNTo3beSnFm-Jilag8V1Q0 May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Id: None May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Domain-Name: None May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Identity-Status: Confirmed May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Is-Admin-Project: True May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Id: default May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Domain-Name: Default May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Project-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Role: reader,member May 16 15:35:15.949994 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Roles: reader,member May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bc74c97613c4462bb551e50800a5f5e2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-Tenant-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Id: default May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Domain-Name: Default May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Id: e916a70861fc44e69160faf793999f6d May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: X-User-Name: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: method: > May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: exception: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.951634 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: action_args: {'id': '11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9'} May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:35:15.953132 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.954759 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: ERROR nova.api.openstack.wsgi May 16 15:35:15.956441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Returning 404 to user: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. {{(pid=117616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:35:15.956441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-4bb43785-d9e8-475d-9ccc-01a8d50b66ee tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "DELETE /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 404 len: 111 microversion: 2.1 time: 0.028784 May 16 15:35:15.956441 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 617/1235] 10.222.0.76 () {58 vars in 1238 bytes} [Mon May 16 15:35:15 2022] DELETE /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:35:15.960558 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '>' {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:15.961167 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.compute.api [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] [instance: 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9] Fetching instance by UUID {{(pid=117615) get /opt/stack/nova/nova/compute/api.py:2920}} May 16 15:35:15.967101 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:15.967554 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:15.968874 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 16 15:35:15.969310 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG oslo_concurrency.lockutils [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Lock "766bbfc3-40e3-4ccb-a93d-d8426b092689" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 16 15:35:15.982379 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.wsgi [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] HTTP exception thrown: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Request method failure captured: May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: request: GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 HTTP/1.1 May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept: application/json May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Accept-Encoding: identity May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Connection: close May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Length: 0 May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Content-Type: application/json May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Host: 10.222.0.76 May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Openstack-System-Scope: None May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: User-Agent: python-urllib3/1.26.9 May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Auth-Token: gAAAAABigm1u_wtAjbFymy6A_wE4Fprc0EtQHG6XwaCSiyO4Ojj-qZWO0fE77nz0-UWGDfmgYftx8SlMc7Ighjjz4PgBUgb9yriA3PaxrrmqQwv3sFyWGm_Kv2WllmwInyg2x7EA_pTzcfDycLSXdEk4FCEgwf_zfjNTo3beSnFm-Jilag8V1Q0 May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Id: None May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Domain-Name: None May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Identity-Status: Confirmed May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Is-Admin-Project: True May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Id: default May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Domain-Name: Default May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Project-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Role: reader,member May 16 15:35:15.983876 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Roles: reader,member May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_bc74c97613c4462bb551e50800a5f5e2", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/bc74c97613c4462bb551e50800a5f5e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}] May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Id: bc74c97613c4462bb551e50800a5f5e2 May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-Tenant-Name: tempest-TestVolumeBootPattern-2133671300 May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Id: default May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Domain-Name: Default May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Id: e916a70861fc44e69160faf793999f6d May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: X-User-Name: tempest-TestVolumeBootPattern-2133671300-project May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: method: > May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: exception: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.985480 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: action_args: {'id': '11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9'} May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: {{(pid=117615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 16 15:35:15.986378 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. May 16 15:35:15.987877 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: ERROR nova.api.openstack.wsgi May 16 15:35:15.989237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: DEBUG nova.api.openstack.wsgi [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Returning 404 to user: Instance 11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 could not be found. {{(pid=117615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 16 15:35:15.989237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO nova.api.openstack.requestlog [None req-64f17a75-1a7d-4b8e-a5f9-a9a4fe65f113 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9" status: 404 len: 111 microversion: 2.1 time: 0.028640 May 16 15:35:15.989237 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: [pid: 117615|app: 0|req: 619/1236] 10.222.0.76 () {58 vars in 1235 bytes} [Mon May 16 15:35:15 2022] GET /compute/v2.1/servers/11e9a511-9524-4c06-ad7d-3c8f1fd9ebd9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 16 15:35:17.457128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: DEBUG nova.api.openstack.wsgi [None req-50bf8acd-4305-47ad-8ed1-7a4d09966f40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] Calling method '.version_select at 0x7fddb3bb03a0>' {{(pid=117616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 16 15:35:17.526734 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO nova.api.openstack.requestlog [None req-50bf8acd-4305-47ad-8ed1-7a4d09966f40 tempest-TestVolumeBootPattern-2133671300 tempest-TestVolumeBootPattern-2133671300-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-88033795" status: 202 len: 0 microversion: 2.1 time: 0.074299 May 16 15:35:17.527306 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: [pid: 117616|app: 0|req: 618/1237] 10.222.0.76 () {58 vars in 1256 bytes} [Mon May 16 15:35:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-88033795 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 16 15:36:13.066472 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:36:13.067098 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Mon May 16 15:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:36:27.429394 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:36:27.430052 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Mon May 16 15:36:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:36:36.949488 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:36:36.950036 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Mon May 16 15:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:38:06.535423 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:38:06.536128 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Mon May 16 15:38:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:38:12.239366 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:38:12.240061 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Mon May 16 15:38:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:38:23.402826 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:38:23.403408 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Mon May 16 15:38:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:39:33.074937 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:39:33.075563 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Mon May 16 15:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:39:47.438942 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:39:47.439607 dv-cinder-790535-39-iscsi devstack@n-api.service[117615]: Mon May 16 15:39:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 16 15:39:56.957722 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 16 15:39:56.958417 dv-cinder-790535-39-iscsi devstack@n-api.service[117616]: Mon May 16 15:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!